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Abstract 

This  is  the  progress  report  of  the  project  “Distributed  Cooperative  Control  of  Multiple  Non¬ 
linear  Systems  with  Nonholonomic  Constraints  and  Uncertainty”.  It  includes  our  achieve¬ 
ments  in  research  and  education  with  the  support  of  this  project. 


Chapter  1 

Problems  Considered  In  This  Project 


Consider  a  group  of  m  mechanical  systems  with  nonholonomic  constraints  and  uncertainty, 
with  the  aid  of  Lagrangian  formulation  the  motion  of  system  j  is  defined  by  [1,2] 

Mj(q*ji  cxj,  (3j)q*j  T  C 'j(q*j,  q*j,  Pj)q*j  T  &ji  fij) 

~\~  D Pj)Tj  T  otj)  Aj  (1-1) 

Jj{q*j,  aj)q*j  =  o  (i-2) 

where  =  [qij, . . . ,  qnj]T  is  the  state  of  system  j,  ctj  is  the  geometric  parameter  uncertainty, 
/3j  is  the  inertia  parameter  uncertainty,  Mj  is  an  n  x  n  bounded  positive-dehnite  symmetric 
matrix,  Cjq*j  is  centripetal  and  Coriolis  force,  Gj  is  gravitational  force,  Dj  includes  un¬ 
modeled  dynamics,  disturbance,  and  noise,  Bj  is  an  n  x  r  input  matrix,  Tj  is  an  r-vector  of 
control  input,  Jj  is  an  (■ n  —  s )  x  n  matrix  with  s  =  n  —  Rank(Jj),  \3  is  an  (n  —  s)-vector  of  the 
constraint  force  on  system  j,  and  the  superscript  T  denotes  the  transpose.  The  constraint 
(1.2)  is  assumed  to  be  completely  nonholonomic  [3].  It  should  be  noted  that  in  eqn.  (1.1) 
there  are  both  parameter  uncertainty  (i.e.,  a3  and  fy)  and  non-parameter  uncertainty  (i.e., 

Dj)- 

For  the  m  systems,  there  is  information  exchange  between 
systems  by  sensors  or  wireless  communication.  For  simple  pre¬ 
sentation,  information  obtained  by  sensors  and  wireless  com¬ 
munications  is  not  distinguished  and  is  considered  as  the  same. 

For  each  system,  the  available  information  for  feedback  design 
is  its  own  information  and  the  information  received  from  its 
neighbors.  If  each  system  is  considered  as  a  node,  the  infor¬ 
mation  exchange  between  systems  can  be  described  by  a  direct 
graph  (i.e.,  digraph)  Q  =  {V,  £}  where  V  =  {1,2, . . . ,  m)  is  a 
node  set  and  £  is  an  edge  set  with  element  that  describes 
the  information  flow  from  node  i  to  node  j.  If  the  information  of  system  i  is  available  to 
system  j,  there  will  be  an  edge  el3  in  £.  System  i  is  said  to  be  a  neighbor  of  system  j  if 
the  information  of  system  i  is  available  to  system  j.  For  system  j ,  the  indices  of  its  neigh¬ 
bors  form  a  set  which  is  denoted  by  Mj.  Therefore,  the  available  information  to  system  j 
for  controller  design  is  the  information  of  system  j  and  the  information  of  system  i  for  all 
i  G  Mj.  For  example,  for  a  group  of  five  systems  with  information  flow  as  in  Figure  1.1, 


Figure  1.1:  Information  flow 
between  systems 
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the  information  flow  can  be  defined  by  the  digraph  Q  =  {V,  £}  where  V  =  {1,  2,  3, 4, 5}  and 

£  —  {^12,  ^25,  632,  643,  654,  651}. 

Before  proposing  the  research  problems  in  this  project,  eqns.  (1.1)-(1.2)  will  be  converted 
into  an  appropriate  form.  Let  the  vector  fields  gij{q*j,  ay),  . . . ,  gSj(q*j,  ay)  form  a  basis  of 
the  null  space  of  Jj(q*j,  ay),  by  eqn.  (1.2)  there  exists  an  s-vector  u*j  =  [u\j, . . .  ,uSj]T  such 
that 

q*j  9*j(q*j,  ay ) v *jj  9iji,q*ji  -t~  ■  ■  ■  t  9sj(,q*ji  ay ) ^ sj  ( f ■  4 ) 

where  g*j(q*j,  ay)  =  [gij{q*j,  ay), . . . ,  gSj(q*j,  ay)]  £  Rnxs.  If  ay  is  assumed  to  be  a  constant 
vector,  differentiating  both  sides  of  (1.3)  and  substituting  it  into  (1.1)  and  multiplying  both 
sides  by  g*j(q*j,  ay)T,  one  has 

Mj{q*j,  ay ,  +  Cj(q*j,  q*j,  (Xj,  f3j)u*j  +  Gj(q*j,  oij,  f3j )  +  Dj(q*j,  otj )  =  Bj(q*j,  atj,  (3j)rj 

(1.4) 

where  it  is  applied  the  fact  that  gj(q*j,<Xj)T Jj(q*j,<Xj)T  =  0,  and  Mj  =  gJrj M0g*j ,  Cj  = 
9jjMj9*j  +gJjCjg*j ,  Gj  =  gJjGj,  D3  =  g  ’  J);.  and  Bj  =  gJjBj. 

System  (1.3)  is  called  the  kinematics  of  system  (1.1)-(1.2).  System  (1.4)  is  called  the 
dynamics  of  system  (1.1)-(1.2).  Eqn.  (1.3)  is  a  drift-less  nonlinear  system  and  is  called  a 
nonholonomic  system.  System  (1.3)-(1.4)  describes  the  motion  of  system  (1.1)-(1.2).  The 
control  problem  defined  for  system  (1.1)-(1.2)  is  equivalent  to  the  control  problem  defined 
for  system  (1.3)-(1.4).  Hereafter,  control  problems  are  defined  for  system  (1.3)-(1.4)  instead 
of  system  (1.1)-(1.2). 

System  (1.3)  is  a  general  drift-less  nonlinear  system  with  uncertainty.  For  many  practical 
systems,  for  example  wheeled  mobile  robots  and  unmanned  aerial  vehicles,  system  (1.3)  can 
be  locally  or  globally  converted  into  the  well-known  chained  form  by  an  appropriate  state 
transformation  [4],  For  example,  if  s  —  2  and  oq  is  known,  there  exists  an  appropriate  state 
transformation 

x*j  T\  ( q*j ,  (Xj ) ,  u T;)  { ([ ,  oij ) v^j  (1.5) 

for  1  <  j  <  m  such  that  system  (1.3)-(1.4)  is  transformed  into  the  following  well-known 
extended  chained  form 


x\j  =  vij,  x2j  =  v2j,  Xij  =  VijXi-ij,  3  <i  <n  (1.6) 

MjV*j  T  CjVitj  +  Gj  +  Dj  =  BjTj  (1.7) 

where  x^_—  [xl3, . . .  ,xnj]T ,  v*j  =  [vij,  v2j]T ,  Mj  =  Tj MjT2,  Cj  =  Tj (MjT2  +  CjT2), 
Gj  =  TjGj,  Dj  =  Tj Dj,  and  Bj  =  TjBj. 

System  (1.6)  is  the  well-known  chained  form  system  with  two  inputs.  If  s  >  2,  in  many 
practical  applications,  system  (1.3)  can  be  converted  into  the  chained  form  system  with 
multiple  inputs  and  multiple-generators  [3]  through  appropriate  state  transformations. 

1.1  Cooperative  Control  of  Multiple  Nonholonomic  Dy¬ 
namic  Systems 

For  multiple  systems  in  (1.3)-(1.4),  the  following  problems  are  considered. 
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Consensus  Problem  of  Dynamic  Systems:  For  a  group  of  m  systems  in  (1.3)-(1.4), 
if  there  is  uncertainty  in  eqns.  (1.3)-(1.4)  and  the  information  exchange  digraph  Q  is  fixed 
or  time- varying,  the  problem  is  how  to  design  a  distributed  control  law  Tj  for  system  j  based 
on  its  own  information  and  its  neighbors’  information  such  that 

hrn  (q*j  —  c)  =  0,  1  <  j  <  m,  (1.8) 

where  c  is  an  unprescribed  constant  vector  which  depends  on  the  initial  condition  of  each 
system  and  the  topology  of  digraph  Q. 

Distributed  Tracking  Control  of  Dynamic  Systems:  For  a  group  of  m  systems  in 
(1.3)-(1.4)  and  a  desired  trajectory  qd  which  is  available  to  a  portion  of  the  m  systems.  If 
there  is  uncertainty  in  eqns.  (1.3)-(1.4)  and  the  information  exchange  digraph  Q  is  fixed  or 
time-varying,  the  problem  is  how  to  design  a  distributed  control  law  Tj  for  system  j  based 
on  its  own  information  and  its  neighbors’  information  such  that 

hrn  (qy,-  —  qd)  =  0,  1  <  j  <  m.  (1.9) 

1.2  Cooperative  Control  of  Multiple  Nonholonomic  Dy¬ 
namic  Systems  with  Non-ideal  Nonholonomic  Con¬ 
straints 

In  eqns.  (1.1)-(1.2),  the  right-side  of  the  constraint  (1.2)  is  assumed  to  be  zero.  In  practice, 
since  the  structure  of  a  mechanical  system  is  not  rigid  or  other  reasons,  the  right-side  of  the 
constraint  (1.2)  may  not  be  zero.  To  deal  with  this  situation,  the  constraint  can  be  described 
by 

Jj  ( Q*j  i  (1.10) 

where  £j(q*j)  is  a  small  perturbation.  Let  the  vector  fields  gij(q*j,ctj),  •••,  gsj(q*j,aj) 
form  a  basis  of  the  null  space  of  Jj(q*j,aj),  by  eqn.  (1.10)  there  exists  an  s-vector  u*j  = 

[■ Uij , . . . ,  uSj)T  such  that 

Q*j  ~  g*j{.g*ji  aj)u*j  t  Jj  {g*j, aj)[Jj{g*ji aj)Jj  (5*7,  aq)]  £j{g*j) 

g*M*j,  ®-j )  ^  t  i  )  ( 1  t  1 ) 

where  g*j(q*j,Q!j)  =  [gij(q*j,ctj), . . . ,  gSj{q*j,aj)]  £  Rnxs.  If  aq  is  assumed  to  be  a  constant 
vector,  differentiating  both  sides  of  (1.11)  and  substituting  it  into  (1.1)  and  multiplying  both 
sides  by  g*j{q*j,  aq)T,  one  has  (1.4),  where  Dj  is  a  new  matrix  and  is  unknown. 

Different  from  eqn.  (1.3),  the  system  in  eqn.  (1.11)  is  not  a  drift-free  system.  Since  6j  is 
generally  small,  system  (1.11)  can  be  considered  as  a  system  in  (1.3)  with  small  perturbation. 
In  eqn.  (1.11),  there  are  both  parameter  uncertainty  and  non-parameter  uncertainty. 

The  dynamics  (1.4)  are  ignored  and  u*j  is  assumed  to  be  a  virtual  control  input.  It  is 
assumed  that  the  geometric  parameter  parameter  aq  is  known  and  that  eqn.  (1.11)  can  be 
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converted  into  the  following  perturbed  chained  form  by  appropriate  transformations  x*j  = 
Ti(q*j,cij)  and  u *,•  =  T2(q*j ,  aj)v*j . 

x2j  =  v2  j  +  (p2j(x3j,Vij), 

Xij  =  Xi- ijVij  +  Vi  Vi  j),  3  <i  <n  (1.12) 

where  xtj  =  [xtj,  ay+ij, . . . ,  a;nj]T,  4>ij  are  unknown  functions  and  satisfy  some  assumptions, 
and  (v\j,  v2j)  are  new  inputs. 

The  following  problems  are  proposed  in  this  project. 

Consensus  Problem  of  Dynamic  Systems  with  Non-ideal  Nonholonomic  Con¬ 
straints:  For  a  group  of  m  systems  in  (1.11)  and  (1.4),  if  there  is  uncertainty  in  eqns. 
(1.11)  and  (1.4)  and  the  information  exchange  digraph  Q  is  fixed  or  (1.8)  is  satisfied,  where 
c  is  unprescribed  constants  which  depends  on  the  initial  condition  of  each  system  and  the 
topology  of  digraph  Q. 

Distributed  Tracking  Control  of  Dynamic  Systems  with  Non-ideal  Nonholo¬ 
nomic  Constraints:  For  a  group  of  m  systems  in  (1.11)  and  (1.4)  and  a  desired  trajectory 
qd  which  is  available  to  a  portion  of  the  m  systems.  If  there  is  uncertainty  in  eqns.  (1.11) 
and  (1.4)  and  the  information  exchange  digraph  Q  is  fixed  or  time- varying,  the  problem  is 
how  to  design  a  distributed  control  law  t3  for  system  j  based  on  its  own  information  and  its 
neighbors’  information  such  that  (1.9)  is  satisfied. 
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Chapter  2 

Summary  of  Achievements 


In  this  chapter,  we  summarize  our  achievements  in  research  and  education. 

2.1  Achievements  in  Research 

In  this  project,  we  studied  the  four  control  problems  and  have  proposed  different  methods 
for  the  proposed  problems.  Fruitful  results  have  been  obtained. 

1.  For  the  consensus  problem  of  dynamic  system,  we  proposed  a  “transverse  function” 
based  approach  with  the  aid  of  backstepping  techniques  (See  Chapter  3).  In  order 
to  solve  the  consensus  problem  of  the  dynamic  systems,  the  solutions  were  proposed 
in  two  steps.  In  the  first  step,  we  assume  that  the  dynamics  of  each  system  can  be 
ignored  and  consider  the  consensus  problem  of  kinematic  systems.  With  the  aid  of  the 
transvere  functions,  distributed  controllers  were  proposed  for  kinematic  systems.  In  the 
second  step,  we  propose  distributed  controllers  for  the  dynamical  systems  with  the  aid 
of  the  backstepping  techniques  and  the  results  in  the  first  step.  Considering  different 
uncertainty  in  the  dynamics  of  each  systems,  distributed  adaptive  and  distributed 
robust  controllers  were  proposed,  respectively.  For  details,  please  see  Chapter  3. 

2.  For  the  distributed  tracking  control  of  dynamic  system,  the  problem  is  solved  in  two 
steps.  In  the  first  step,  we  solve  the  distributed  tracking  problem  of  multiple  kinematic 
systems.  In  the  second  step,  we  solve  the  distributed  tracking  control  problem  of 
dynamic  systems  with  the  aid  of  the  results  in  the  first  step. 

•  For  tracking  control  of  kinematic  systems,  we  have  obtained  the  following  results. 

(a)  Distributed  tracking  control  of  multiple  nonholonomic  chained  systems  is  consid¬ 
ered  by  using  neighbours’  information.  With  the  aid  of  the  cascade  structure  of 
each  system  and  properties  of  persistently  excited  signals,  distributed  state  feed¬ 
back  tracking  controllers  and  distributed  output  feedback  tracking  controllers  are 
proposed  such  that  the  tracking  errors  exponentially  converge  to  zero.  To  show 
applications  of  the  proposed  results,  formation  control  of  wheeled  mobile  robots 
is  considered.  Distributed  controllers  are  obtained  with  the  aid  of  the  proposed 
theorems.  See  Chapter  4  for  details. 
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(b)  The  leader- following  consensus  problem  of  multiple  chained  systems  with  directed 
communication  topology  is  considered.  If  the  state  of  each  system  is  measurable, 
distributed  state  feedback  controllers  are  proposed  using  neighbors’  state  informa¬ 
tion  with  the  aid  of  Lyapunov  techniques  and  properties  of  Laplacian  matrix  for 
time-invariant  communication  graph  and  time- varying  communication  graph.  It  is 
shown  that  the  states  of  the  systems  reach  consensus  exponentially.  If  the  state  of 
each  system  is  not  measurable,  distributed  observer-based  output  feedback  control 
laws  are  proposed.  As  an  application  of  the  proposed  results,  formation  control 
of  wheeled  mobile  robots  is  studied.  The  simulation  results  show  the  effectiveness 
of  the  proposed  results.  See  Chapter  5  for  details. 

(c)  The  distributed  formation  control  of  multiple  nonholonomic  wheeled  mobile  robots 
with  a  leader  is  considered.  Distributed  tracking  control  laws  are  proposed  with 
the  aid  of  results  of  cascade  systems  such  that  the  centroid  of  the  states  of  a  group 
of  mobile  robot  exponentially  tracks  the  leader.  See  Chapter  6  for  details. 

•  For  tracking  control  of  multiple  dynamic  systems,  we  have  obtained  the  following 
results. 

(a)  The  leader- following  control  problem  of  multiple  mechanical  systems  with/without 
velocity  constraints  using  neighbors’  information  is  considered  with  the  aid  of  neu¬ 
ral  networks.  With  the  aid  of  the  approximation  property  of  neural  networks,  the 
cascade  structure  of  each  system,  and  the  properties  of  linear  time-varying  sys¬ 
tems,  based  distributed  robust  adaptive  state  feedback  controllers  are  proposed 
such  that  the  state  of  each  follower  system  asymptotically  converges  to  the  state 
of  a  leader  system.  To  verify  the  proposed  results,  formation  control  of  wheeled 
mobile  robots  and  synchronization  of  multiple  2-DOF  manipulators  are  consid¬ 
ered.  Distributed  controllers  are  obtained  with  the  aid  of  the  proposed  results. 
Simulation  results  show  the  effectiveness  of  the  proposed  results.  See  Chapter  7 
for  details. 

(b)  Formation  tracking  control  of  multiple  wheeled  mobile  robots  is  studied.  The 
reference  trajectory  is  considered  as  a  virtual  leader  vehicle  system  while  the  real 
multiple  vehicle  systems  are  considered  as  follower  agents.  Chained-form  systems 
and  theories  of  cascaded  systems  and  communication  graph  are  introduced  to 
design  control  methods  for  kinematic  systems.  In  addition  to  distributed  con¬ 
trol  algorithms  for  kinematic  multi-vehicle  systems,  formation  control  of  vehicles 
dynamics  is  addressed  with  the  aid  of  backstepping  method,  parametrical  uncer¬ 
tainties  of  vehicles  mechanics  are  estimated  by  sliding  mode  control.  See  Chapter 
8  for  details. 

(c)  Distributed  tracking  control  is  considered  for  multiple  wheeled  mobile  robots. 
Laplacian  matrix  is  introduced  to  characterize  the  communication  topology.  Since 
there  are  parameter  uncertainties  for  each  mechanical  system,  adaptive  control 
method  is  applied  for  controller  design  of  the  dynamical  systems.  Distributed 
adaptive  state  feedback  control  laws  are  presented  with  the  aid  of  the  agents 
neighboring  information.  See  Chapter  9  for  details. 
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(d)  It  is  considered  the  teleoperation  of  a  cluster  of  mobile  robots  that  are  required 
to  follow  a  desired  trajectory  while  maintaining  a  desired  rigid  formation  pattern. 
The  centroid  of  the  robot  formation  is  modeled  as  a  virtual  robot.  Distributed 
control  laws  designed  using  a  backstepping  method  are  proposed  for  each  robot 
with  the  aid  of  neighbors  information.  It  is  shown  that  the  motion  of  the  centroid 
of  the  cluster  of  robots  is  synchronized  to  that  of  the  virtual  robot.  The  theoretical 
results  are  validated  by  simulations  on  a  cluster  of  five  mobile  robots.  See  Chapter 
10  for  details. 

3.  For  the  consensus  problem  of  dynamic  systems  with  non-ideal  nonholonomic  con¬ 
straints,  a  transverse  function  based  approach  was  proposed.  In  this  approach,  two 
problems  were  solved  step  by  step.  We  first  propose  distributed  controllers  for  kine¬ 
matic  systems  with  the  aid  of  graph  theory.  Then,  we  propose  distributed  controllers 
for  multiple  dynamic  systems.  If  the  uncertainty  in  the  dynamics  is  parametric,  dis¬ 
tributed  adaptive  controllers  are  proposed.  If  the  uncertainty  in  the  dynamics  is  non- 
parametric,  distributed  robust  controllers  are  proposed.  For  details,  please  see  Chapter 
11, 

4.  For  the  distributed  tracking  control  of  dynamic  systems  with  non-ideal  nonholonomic 
constraints,  we  considered  distributed  tracking  control  of  kinematic  systems  and  dis¬ 
tributed  tracking  control  of  dynamic  systems.  For  these  two  problems,  practical  dis¬ 
tributed  tracking  controllers  are  proposed  with  the  aid  of  robust  control  and  graph 
theory.  The  method  proposed  for  the  problems  can  be  applied  to  solve  distributed 
racking  control  of  multiple  systems  with  more  general  forms.  For  detail,  please  see 
Chapter  12. 

5.  In  addition  solving  the  problems  proposed  in  this  proposal,  we  also  solve  the  cooperative 
of  other  related  problems.  The  following  problems  have  been  studied  and  the  solutions 
for  them  have  been  obtained. 

(a)  Consensus  Seeking  of  Nonlinear  Systems:  Two  consensus  problems  of  multiple 
nonlinear  systems  are  considered.  In  the  first  consensus  problem,  distributed 
control  laws  for  multiple  nonlinear  systems  are  proposed  such  that  the  state  of  each 
system  converges  to  a  constant  agreement  vector  with  the  aid  of  communications 
between  systems.  In  the  second  consensus  problem,  distributed  robust/adaptive 
control  laws  for  multiple  nonlinear  systems  are  proposed  such  that  the  state  of 
each  system  converges  to  the  state  of  a  reference  system  whose  state  is  available 
to  a  portion  of  multiple  systems. 

(b)  Distributed  Estimated-Based  Tracking  Control  of  Multiple  Uncertain  Nonlinear 
Systems:  It  is  considered  the  tracking  control  of  multiple  uncertain  nonlinear  sys¬ 
tems  with  a  desired  signal  which  is  not  available  to  each  system.  An  estimation- 
based  controller  design  approach  is  proposed.  Distributed  estimation-based  adap¬ 
tive  controllers  are  proposed  with  the  aid  of  Lyapunov  techniques  and  results  from 
graph  theory.  Simulation  results  show  the  effectiveness  of  the  proposed  controllers. 
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(c)  Distributed  Output  Tracking  Control  of  Heterogeneous  linear  Agents:  Distributed 
output  tracking  control  of  a  leader  is  considered.  If  the  state  of  each  system  is 
measurable,  distributed  state  feedback  controllers  are  proposed  such  that  the  out¬ 
put  of  each  system  asymptotically  converges  to  the  output  of  the  leader  with  the 
aid  of  the  internal  model  principle.  If  the  state  of  each  system  is  not  measurable, 
distributed  output  feedback  controllers  are  proposed  with  the  aid  of  state  estima¬ 
tion  such  that  the  output  of  each  system  asymptotically  converges  to  the  output 
of  the  leader.  Simulation  study  validates  the  proposed  results. 

(d)  Consensus  of  uncertain  nonlinear  systems:  For  multiple  nonlinear  systems  the 
consensus  control  problem  is  considered.  Consensus  algorithms  are  proposed  with 
the  aid  of  Lyapunov  techniques  and  results  from  graph  theory.  To  show  the 
effectiveness  of  the  proposed  algorithms,  simulation  results  are  presented. 

(e)  Consensus  seeking  of  heterogeneous  nonlinear  agents:  It  is  considered  the  consen¬ 
sus  seeking  problem  of  multiple  heterogeneous  nonlinear  systems  with  a  leader. 
With  the  aid  of  distributed  estimation,  distributed  state  feedback  laws  are  pro¬ 
posed  such  that  the  output  of  each  system  converges  to  the  output  of  the  leader 
system.  Simulation  results  show  effectiveness  of  the  proposed  control  laws. 

(f)  Robut /Adaptive  Tracking  Control  of  Wave- Adaptive  Modular  Vessel  with  Llncer- 
tainty:  It  is  considered  the  tracking  control  of  a  wave  adaptive  modular  vessel 
(WAM-V)  with  unknown  inertia  parameters  and  disturbance.  To  overcome  the 
underactuated  nature,  practical  control  laws  are  proposed.  If  the  inertia  parame¬ 
ters  are  not  exactly  known,  a  robust  control  law  is  proposed  such  that  the  tracking 
error  of  the  position  of  the  WAM-V  exponentially  converges  to  a  small  neighbor¬ 
hood  of  the  origin.  If  the  inertia  parameters  are  unknown,  a  robust  adaptive 
control  law  is  proposed  such  that  the  tracking  error  of  the  position  of  the  WAM- 
V  asymptotically  converges  to  a  small  neighborhood  of  the  origin.  In  both  cases, 
the  radius  of  the  neighborhood  can  be  as  small  as  possible  by  choosing  a  small 
control  parameter.  Simulation  has  been  done  to  show  the  effectiveness  of  the 
proposed  control  laws. 

(g)  Robut /Adaptive  Tracking  Control  of  Wave-Adaptive  Modular  Vessel  with  Un- 
known  Inertia  Parameters:  This  paper  considers  formation  control  of  multiple 
wave-adaptive-modular  vessels  (WAM-Vs)  with  the  aid  of  neighbors’  informa¬ 
tion.  Considering  the  water  currents,  it  is  assumed  that  the  dynamics  of  each 
WAM-V  is  not  exactly  known  and  is  subjected  to  disturbance.  To  overcome  the 
underactuated  nature  of  a  WAM-V,  practical  distributed  robust  tracking  con¬ 
trollers  are  proposed  if  estimates  of  inertia  parameters  are  known.  If  the  inertia 
parameters  are  unknown,  practical  distributed  adaptive  tracking  controllers  are 
proposed.  Simulation  results  show  the  effectiveness  of  the  proposed  controllers. 

6.  In  order  to  test  our  proposed  results,  a  testbed  of  cooperative  control  of  four  wheeled 
robots  has  been  built.  In  this  testbed,  there  are  four  P3-AT  mobile  robots.  Each 
robot  is  equipped  with  a  camera  and  a  laser  sensor.  Between  robots,  there  is  wireless 
communication  with  the  aid  of  university  wireless  infrastructure  or  an  access  point.  The 
proposed  algorithms  can  be  applied  to  make  the  robots  move  in  a  desired  formation. 


7.  Implement  of  control  algorithms  in  the  testbed.  Some  algorithms  have  been  imple¬ 
mented  in  the  testbed  in  our  lab.  The  effectiveness  of  the  proposed  algorithms  have 
been  verified. 


2.2  Achievements  in  Education 

With  the  aid  of  the  support  of  this  funds,  five  graduate  students  have  been  financially 
supported.  The  students  have  been  involved  in  this  research  and  received  training  in  their 
research.  Some  students  have  presented  their  research  results  in  well-known  professional 
automatic  control  meetings  and  published  their  research  results  in  peer-reviewed  conference 
proceedings. 

1.  Chunyu  Chen,  Yifan  Xing,  Vladimir  Djapic,  and  Wenjie  Dong,  “Distributed  Formation 
Tracking  Control  of  Multiple  Mobile  Robotic  Systems,”  Proc.  of  IEEE  Decision  and 
Control  Conference,  December,  2014. 

2.  C.  Chen  F.  De  La  Torre,  and  W.  Dong,  “Distributed  Exponentially  Tracking  Control 
of  Multiple  Wheeled  Mobile  Robots,”  Proc.  of  American  Control  Conference,  2014, 
pp.  4014-4019. 

3.  Felipe  De  La  Torre  and  W.  Dong  ,  “Distributed  exponential  formation  control  of  mul¬ 
tiple  wheeled  mobile  robots,”  Proc.  of  Int.  Conf.  on  control,  Dynamic  Systems,  and 
Robotics,  Ottawa,  Canada,  May,  2014. 

4.  Z.  Sheng,  W.  Dong,  and  Jay  Farrell,  “Quaternion-Based  Trajectory  Tracking  Control 
of  VTOL-UAVs  Using  Command  Filtered  Backstepping,”  Proc.  of  American  control 
Conference,  pp.  1020-1025,  2013. 

Two  graduate  students  have  graduated  and  two  master  thesis  have  been  produced. 

1.  Chunyu  Chen,  Distributed  formation  tracking  control  of  multiple  car-like  robots.  Mas¬ 
ter  thesis,  Department  of  Electrical  Engineering,  the  LIniversity  of  Texas  -  Pan  Amer¬ 
ican,  May,  2014. 

2.  Yifan  Xing,  Dlistributed  coordinae  tracking  control  of  multiple  wheeled  mobile  robots. 
Master  thesis,  Department  of  Electrical  Engineering,  the  LIniversity  of  Texas  -  Pan 
American,  March,  2015. 

2.3  Publications 

For  this  project,  four  peer-reviewed  journal  papers  and  seven  peer-reviewed  conference  papers 
have  been  published. 

Peer-reviewed  journal  papers: 
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1.  W.  Dong  and  V.  Djapic,  “Leader- following  control  of  multiple  nonholonomic  systems 
with  over  directed  communication  graphs,”  Int.  J.  of  Systems  Science,  accepted  for 
publication,  2014 

2.  W.  Dong,  C.  Chen,  and  Y.  Xing,  ’’Distributed  estimation-based  tracking  control  of 
multiple  uncertain  non-linear  systems”,  Int.  J.  of  Systems  Science,  vol.  45,  no.  10,  pp. 
2088-2099,  2014. 

3.  W.  Dong,  “Distributed  Tracking  Control  of  Networked  Chained  Systems,”  Int.  J.  of 
Control,  vol.  86,  no.  12,  pp.  2159-2174,  2013. 

4.  W.  Dong,  “Adaptive  Consensus  Seeking  of  Multiple  Nonlinear  Systems,”  Int.  J.  of 
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10 


Chapter  3 

Consensus  of  Multiple  Nonholonomic 
Mechanical  Systems 


In  this  chapter,  we  consider  the  consensus  problem  of  multiple  nonholonomic  mechanical 
systems.  In  order  to  solve  the  problem  defined  in  the  proposal,  we  solve  several  consensus 
problems  step  by  step. 

3.1  Distributed  Controller  Design  for  Chained  Systems 

Consider  m  systems  in  (1.5),  i.e., 


Vlj 

=  Vlj 

(3.1) 

X2j 

=  v2j 

(3.2) 

Xij 

,  3  <  i  <  n 

(3.3) 

The  communication  between  systems  is  defined  by  a  directed  graph  Q  =  {V,  £}.  We  consider 
the  following  problem  in  this  section. 

Consensus  of  Multiple  Chained  Systems:  For  a  group  of  m  systems  in  (3.1)-(3.3), 
the  problem  is  how  to  design  a  distributed  control  law  (wij,  v2j)  for  system  j  based  on  its 
own  information  and  its  neighbors’  information  such  that 

hm  (x*j  —  c)  =  0,  1  <  j  <  m,  (3.4) 

where  x*j  =  [x\j, . . .  ,xnj]T  and  c  is  an  unprescribed  constant  vector  which  depends  on  the 
initial  condition  of  each  system  and  the  topology  of  digraph  Q . 

The  system  (3.1)-(3.3)  has  a  cascade  structure.  (3.1)  is  a  linear  system  and  (3.2)-(3.3)  is 
a  linear  time- varying  system.  We  propose  the  following  results  for  the  system  in  (3.1). 

Lemma  3.1.  For  m  systems  in  (3.1),  the  distributed  control  law 


Vlj 

Vij 


Vij 

—k\X\j  +  Cij 
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(3.5) 

(3.6) 


Cij  = 

—  &2C1  j  +  C2  j 

(3.7) 

n-3,j  = 

kn—2Cn—3,j  T  Cn— 2,j 

(3.8) 

■n-2,j  = 

.  dji(Cn—2,j  Cn— 2,i 

i&Mj 

i)  -  b(Cn-2,j  -  a)  +  a 

(3.9) 

ensures  that 

lim  (x\j  —  xu)  e=  0,  1  <  j  7^  l  <  m  (3.10) 

t—>  OO 

where  aji  are  positive  constants,  b  >  0,  hi  >  0  for  1  <  i  <  n  —  2,  and  a  is  a  variable. 
Furthermore,  if  a  is  a  bounded  persistently  excited  signal  and  a  is  also  bounded,  then  Vy  is 
a  bounded  PE  signal  and  limt^00(uiJ  —  vu)  0  for  1  <  j  ^  l  <  m. 

Proof:  Let  ( n-2,j  =  Cn- 2,j  ~  «  and  (n-2,*  =  [Cn-2,1,  ■  ■  •  ,Cn-2,m]T,  with  the  control  laws 
we  have 

Cn— 2,*  =  —£(n-2,*  —  b(n-2,*  =  —(£  +  bI)(n_2,*-  (3.11) 

where  C  is  the  Laplacian  matrix.  Since  b  >  0,  ( C  +  bl )  is  a  Hurwitz  matrix.  Therefore,  ( n-2 ,* 
exponentially  converges  to  zero,  which  means  that  (n-2 ,j  exponentially  converges  to  a. 

Let  Xiji  =  Xy  —  Xu  and  Qji  =  Qj  —  Qi  for  1  <  i  <  n  —  3  and  1  <  j  ^  l  <  m,  then 

%i,ji  =  —k\X\ ji  +  Ci  ,ji 
Ciji  =  -fa(i  ,ji  +  C2  ,ji 

Cn— 3 ,jl  kn—2Cn—3,jl  T  Cn—2,jl 

Since  kn- 2  is  positive  and  (n-2,ji  exponentially  converges  to  zero,  it  is  obvious  that  Cn-3,ji 
exponentially  converges  to  zero.  Similarly,  it  can  be  proved  that  Cn-3 ,ji  exponentially  con¬ 
verges  to  zero.  Repeat  this  procedure,  it  can  be  proved  that  Xiji  exponentially  converges  to 
zero. 

Since  limt^00(xij  -  xu)  '='  0  and  limt_>00(Cij  -  Cn)  0,  limt_foo(uij  -  vn)  '  =  '  0.  By 
(3.6)-(3.9),  x\ j  =  H(s)Cn-2,j  where  H(s)  =  nn_3.1 — —  and  H(s)  is  a  stable,  minimum  phase, 

proper  rational  transfer  function.  So,  Vy  =  sH(s)Cn-2,j-  If  is  obvious  that  sH(s)  is  also  a 
stable,  minimum  phase,  proper  rational  transfer  function.  By  Lemma  4.8.3  in  [5],  V\3  is  a 
bounded  PE  signal.  ■ 

Remark  3.1.  In  Lemma  3.1,  a  is  a  control  parameter.  The  reason  for  introducing  it  will 
be  clear  later. 

Remark  3.2.  In  Lemma  3.1,  b  is  a  positive  constant.  Actually,  b  can  be  zero  for  some 
systems. 
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With  the  aid  of  the  results  in  Lemma  3.1,  we  are  ready  to  design  controllers  for  the 
systems  in  (3.2)-(3.3).  We  define  the  variables 


zi;j  =  Xij  +  Pij,  2  <  i  <  n 


(3.12) 


where 


finj 

=  0 

) 

„,2n-5 

n-1  ,j 

=  Vlj 

Pij 

=  4r5 

then  we  have 


d  S - A+ij, 

Vlj 


Z2j  —  V2  j  +  02  j 

Zij  v  |  j  Zij  4“  v  ij  Zi—  \  j ,  3  <  i  <  n 


(3.13) 

(3.14) 


ft  should  be  noted  that  the  transform  defined  in  (3.4)  is  global  since  /%  is  well-defined 
because  its  special  form.  The  following  results  can  be  proved. 


Lemma  3.2.  By  the  transform  (3.4),  if 


lim  ( z^  —  zn)  =  0,  2  <  i  <  n;  1  <  j  0  l  <  m 

t— >oo  J 


(3.15) 


then 


lim  (xij  —  Xu)  =  0,  2  <  i  <  n\  1  <  j  ^  l  <  m. 


(3.16) 


The  system  (3.13)-(3.14)  has  a  special  structure.  We  will  take  advantage  of  this  structure 
and  have  the  following  results. 

Lemma  3.3.  If  v\j  is  a  bounded  PE  signal,  z^  and  zn  are  bounded,  and 

lim  (z2j  -  z2i)  =  0,  1  <  j  7^  I  <  m  (3.17) 

£—>■00 

then  (3.15)  holds. 

Proof:  For  systems  j  and  l  and  j  ^  /,  we  define  e  =  z-$j  —  z^i-  Then 

e  =  ~Vy~4e  +  «"4  -  vl]~4)z2i  +  {vijZ2j  -  v2iz2i)  (3.18) 

Since  v\j  is  a  bounded  PE  signal  and  (z2]  —  z2i)  converges  to  zero,  it  is  obvious  that  e 
converges  to  zero,  which  means  that  z3j  converges  to  z3i.  Similarly,  we  can  prove  that  zl} 
converges  to  zu  for  i  =  4,  5, . . . ,  n.  ■ 

Thanks  to  Lemma  3.3  and  Lemma  3.2,  it  only  needs  to  design  v2j  such  that  (3.17)  holds. 
We  have  the  following  results. 
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Lemma  3.4.  If  the  communication  digraph  has  a  spanning  tree,  the  control  law 


(3.19) 

(3.20) 


v2j  =  m  j 

V2 j  =  -  aAZV  -  Z2i)  -  $2 j 

*eA fj 

ensures  that  (3.16)  holds. 

Combine  the  results  in  Lemma  3.1  and  Lemma  3.4,  we  have  the  following  results. 

Theorem  3.1.  For  the  m  systems  in  (3.1)-(3.2),  if  the  communication  digraph  has  a  span¬ 
ning  tree  and  a  is  a  bounded  PE  signal  and  a  is  bounded,  the  control  laws  (3.5)  and  (3.20) 
for  system  j  ensure  that  (3.4)  holds,  where  the  control  parameters  are  defined  in  Lemmas 

3.1  and  3-4- 

In  Theorem  3.1,  a  is  required  to  be  a  bounded  PE  signal.  There  are  many  choices  of  a. 
For  example,  we  can  choose  a(t)  =  sin  t. 

There  are  other  methods  for  designing  distributed  controllers  for  the  kinematic  systems 
in  (3.1)-(3.3).  For  example,  the  method  proposed  in  our  paper  [6]  can  be  applied  to  propose 
distributed  controllers. 

3.2  Distributed  Controller  Design  for  Driftless  Systems 

In  the  this  section,  we  considered  the  following  driftlcss  systems 

Q*j  9ijvij  T  gSjVsj  9*jv*j  (3.21) 

where  gij,  . . . ,  gSj  are  smooth  functions  on  Rn  such  that  in  a  neighborhood  of  0  the  dimension 
of  the  distribution  A j(q*j)  =  Span{g(q*j )  :  g  G  Lie{g\j , . . .  ,gSj}}  is  n. 

The  problem  considered  in  this  section  is  as  follows. 

Consensus  of  Multiple  Systems:  For  a  group  of  in  systems  in  (3.21),  the  problem  is 
how  to  design  a  distributed  control  law  u*j  for  system  j  based  on  its  own  information  and 
its  neighbors’  information  such  that 

hrn  (qy,-  —  c)  =  0,  1  <  j  <  m,  (3.22) 

where  c  is  an  unprescribed  constant  vector  which  depends  on  the  initial  condition  of  each 
system  and  the  topology  of  digraph  Q. 

Practical  distributed  controllers  can  be  proposed  with  the  aid  of  the  transverse  function. 
For  simplicity,  we  assume  the  communication  between  systems  is  bi-directional  in  this  section. 
With  the  aid  of  the  results  in  [7],  we  have  the  following  results. 

Lemma  3.5.  For  the  system  in  (3.21),  if  the  dimension  of  the  distribution  Span{q(a;)  :  g  G 
Lie{gij, . . . ,  gSj}}  is  n,  there  exists  a  function  fj(/3*j,  Cj )  G  Rn  such  that  the  matrix 

£)f  ■  £)j-  ■ 

=  9ij{fj)i  92j(fj),  ■  ■  ■ ,  9sji  •  •  •  ’  ~j~j  i 

is  nonsingular  for  any  (3*j  and  Cj  >  0,  where  (3*j  =  [fiij,  ■  ■  ■ ,  /3n-2j\T ,  (4  G  Rn~2  and  the 
function  fj  has  the  following  properties: 
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1.  fj  is  bounded  for  any  /3*j ; 

2.  lim£j._^0  fj(P*j,Cj)  =  0. 


The  proof  of  Lemma  3.5  can  be  found  in  [7,  8].  The  construction  of  fj  can  be  found  also 
in  [7,8].  The  function  fj  is  called  the  transverse  function. 

With  the  aid  of  Lemma  3.5,  it  can  be  found  the  function  fj(/3j,  ef)  such  that  Gj  is 
nonsingular.  Define 

z*j  =  q*jfj(/3*j,£j)  (3.23) 

then,  we  have 

z*j  —  d'rfj(/3tj)((l*j)dlZt:j(fj(f3*j))Hj(yf3:tj) 

where  the  meaning  of  the  notations  can  be  found  in  [7]. 

We  define  the  neighbors’s  difference  as 

e*j  [cij,  *  •  * )  &nj\  'y )  &ji(z*j  z*f) .  (3.25) 

i&Mj 


-*j 


-A 


*j 


(3.24) 


If  $*j  is  considered  as  an  additional  input,  we  propose  the  following  distributed  control  law. 


Theorem  3.2.  For  the  m  systems  in  (3.21),  if  the  communication  graph  has  a  spanning 
tree,  the  control  law 


vij  =  Vi  j 


Vsj  —  Vsj 


Vij 

—  Hj({3*j)  dlz-i(q*j)dr  fj(p*j)(z*j) 

^  ^  %*i) 

Vsj 

*3 

ieMj 

ensures  that 


(3.26) 

(3.27) 

(3.28) 


lirn  || q*j  -  qH\\  <  S(e  ef).  (3.29) 

t— >oo 

where  S(eei)  is  a  nonnegative  continuous  function  of  et  and  €j  and  lim|e  .|+|ej|_».o  ^(e,ei)  —  0. 

Proof:  By  Lemma  3.5,  Gj  is  nonsingular.  So,  the  control  law  exists.  Substitute  the 
control  law  into  the  system,  we  have 


z±j  —  e±j 

Znj  &nj 
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(3.30) 

(3.31) 

(3.32) 


Choose  a  function 


V  =  zT  Lz ■ 

where  =  [ztl , . . . ,  zin]T  and  C  is  the  Laplacian  matrix,  we  have 

v  =  -ZT  r2z- 

By  integrating  both  sides  of  the  above  inequality,  it  can  be  shown  that  z^  is  bounded  and 
Cziif  converges  to  zero,  which  means  that  (ztj  —  zt[)  converges  to  zero  for  1  <  j  Y  l  <  m. 
Therefore,  (3.29)  holds.  ■ 

Remark  3.3.  If  Cj  is  chosen  to  be  a  small  constant,  ||  fj  —  ft  ||  is  a  small  constant,  which 
means  that  \\x*j  —  x*j||  converges  to  a  small  neighborhood  of  the  origin.  We  say  (3.22)  is 
achieved  practically. 

Remark  3.4.  In  Theorem  3.2,  nothing  is  said  about  (3*j.  So,  f3*j  may  be  bounded  or  un¬ 
bounded.  Thanks  to  the  properties  of  the  function  fj ,  the  boundedness  of  (T3  plays  no  role  in 
the  consensus  problem. 

3.3  Distributed  Controller  Design  for  Dynamical  Sys¬ 
tems 

We  consider  m  systems.  The  j-th  system  is  defined  as 

Xij  =  Vi  j,  ±2  j  =  v2j,  Xij  =  VijXi-ij,  3  <  i  <  n  (3.33) 

MjV*j  +  CjV*j  +  Gj  +  Dj  =  BjTj  (3.34) 

where  v*3  =  [vij,v2jY  and  x*3  =  (x\3, . . . ,  xn]\T .  The  following  properties  are  satished. 

Property  3.1.  M3  is  bounded  and  M3  —  2 C3  is  skew- symmetric. 

Property  3.2.  For  any  differentiable  vector  £  G  R2 , 

Mji  T  Gj  f  T  Gj  Ypx^j,  x^j ,  f ,  f )  o3 

where  Yj  is  a  known  function  of  x*j,  x*3 ,  f,  and  f,  and  aj  is  the  inertia  parameter  vector. 
The  problem  considered  in  this  section  is  defined  as  follows. 

Consensus  of  Multiple  Systems:  For  a  group  of  m  systems  in  (3.33)-(3.34),  the  prob¬ 
lem  is  how  to  design  a  distributed  control  law  t3  for  system  j  based  on  its  own  information 
and  its  neighbors’  information  such  that 

lim  (x*,  —  c)  =  0,  1  <  j  <  m,  (3.35) 

t— >oo  J 

where  x*3  =  (x\3, . . . ,  xn3]T  and  c  is  an  unprescribed  constant  vector  which  depends  on  the 
initial  condition  of  each  system  and  the  topology  of  digraph  Q . 


16 


In  the  dynamics  (3.34),  we  first  assume  that  the  inertia  parameter  vector  a3  is  a  constant 
and  is  unknown. 

In  order  to  design  controllers  for  the  systems  in  (3.33)-(3.34),  we  let 


vij  =  Vi j  -  rjij  (3.36) 

V2j  =  v2j  -  r}2jy  1  <  j  <  m  (3.37) 

where  rj\j  and  ij2 j  are  defined  in  (3.5)  and  (3.20),  respectively.  Then  we  have 

xij  =  rjij  +  vij  (3.38) 

x2  j  =  rj2j  +  h2  j  (3.39) 

=  (rj^  +  vij)xi-ij,  3  <  i  <  n  (3.40) 

MjV*j  +  CjV*j  =  BjTj  —  (MjV*j  T  CjT]*j  -\-  Gj  +  Dj)  (3.41) 

where  v =  [vij,v2j]T. 

For  the  systems  in  (3.38)-(3.40),  we  have  the  following  results. 


Lemma  3.6.  For  the  m  systems  in  (3.38)- (3.40),  if  the  communication  digraph  has  a  span¬ 
ning  tree,  then 

1.  x^  —  xu  is  bounded  for  1  <  i  <  n  and  1  <  j  ^  l  <  m  if  v\3  and  v2j  ave  bounded  for 
1  <)  <  rn. 

2.  x^  —  xu  converges  to  zero  for  1  <  i  <  n  and  1  <  j  ^  l  <  m  if  vij  and  v2j  converge  to 
zero  for  1  <  j  <  m. 

Proof:  Let  xiji  =  X\3  —  xu,  we  have 

xiji  =  -hxiji  +  Ci ,ji  +  v^  -  Vi i  (3.42) 

Since  Ci ji  exponentially  converges  to  zero,  the  system  (3.42)  has  the  input- to-state  stability 
property  for  input  (hi j  —  Vu).  This  means  that  xiji  is  bounded  if  Vi3  and  vu  are  bounded 
and  xiji  converges  to  zero  if  V\3  and  vu  converge  to  zero. 

For  the  systems  in  (3.39)-(3.40),  with  the  aid  of  the  transform  in  (3.4),  we  have 

z2j  —  V2j  +  $2j  +  V2  j  (3.43) 

Zij  =  ~vlj~4Zij  +  VijZi-ij,  3  <i<n  (3.44) 

It  can  be  proved  recursively  that  zl3  is  bounded  if  is  bounded  and  zl}  converges  to 

zero  if  zt- 1 j  converges  to  zero.  Therefore,  x^  —  xu  converges  to  zero  for  2  <  i  <  n  and 
1  <  j  7^  l  <  m  if  Vij  and  v2]  converge  to  zero  for  1  <  j  <  m.  ■ 

With  the  aid  of  the  results  in  Lemma  3.6,  we  can  design  controllers  such  that  hi*  and  v2* 
are  bounded  and  converge  to  zero. 

For  the  dynamics  of  each  system,  we  have 

Mj'fj^j  +  CjT]*j  +  Gj  =  Yj(  x*j  5  j  ^  (3.45) 
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where  aj  is  the  inertia  parameter.  For  the  disturbance  Dj,  it  is  assumed  that 

\\Dj\\  <  Pj(x*j)  (3.46) 

where  pj  is  a  known  function  of  x*,.  If  the  inertia  parameter  aj  is  a  constant  and  is  unknown, 
we  have  the  following  results. 

Theorem  3.3.  For  the  m  systems  in  (3.33)-(3.34),  if  the  communication  digraph  has  a 
spanning  tree,  the  control  law 

tj  =  Bj 1  +  Yjhj  -  pjSign(h*j)  (3.47) 

aj  =  -TjYjv^j  (3.48) 

ensures  that  (3.35)  holds  and  dj  is  bounded,  where  Kj  and  Tj  are  positive  constant  matrices. 


Proof:  Let 

vi  =  2 v*Av*j  +  2  (ai  -  ai)r 7X(ai  “  ai) 

Differentiating  it  along  the  closed-loop  system,  we  have 

Vj  =  -vJjKjVtj  -  pjvJjSign^j)  -  vJjDj 
<  -vJjKjV^j  <  0 

Therefore,  V3  is  bounded,  which  means  that  v*3  and  dj  are  bounded.  By  Barbalat’s  lemma, 
it  can  be  shown  that  v*j  converges  to  zero.  ■ 

In  Theorem  3.3,  the  unknown  inertia  parameter  is  estimated  by  an  adaptive  control  law. 
If  an  estimate  of  a3  is  dj  and 

II aj  ~~  dj ||  <  7 j 

for  1  <  j  <  m  and  7 j  is  a  known  constant,  we  propose  the  following  robust  control  laws. 

Theorem  3.4.  For  the  m  systems  in  (3.33)-(3.3f),  if  the  communication  digraph  has  a 
spanning  tree,  the  control  law 

Tj  =  Bj 1  —KjV*j +  Yjdj  —  rYjYjsign(Yjvv*j)  -  pjSign(v*j)  (3.49) 

ensures  that  (3.35)  holds,  where  Kj  is  a  positive  constant  matrix. 


Proof:  Let 


vi  =  2  v*jV*j 


Differentiating  it  along  the  closed-loop  system,  we  have 


Vj  =  -vJjKjKj  -  pjvJjSign(v*j)  -  vJjDj 

+vJjYj(dj  -  aj)  -  ^jV~ljYjS\gn(Yj v^j) 
<  ~vJjKjV*j  <  0 


Therefore,  Vj  is  bounded,  which  means  that  v*j  is  bounded.  By  Barbalat’s  lemma,  it  can  be 
shown  that  v*j  converges  to  zero.  ■ 

In  Theorem  3.4,  the  unknown  inertia  parameter  a.j  is  not  required  to  be  a  constant.  In 
the  control  laws,  7 j  is  required  to  be  known.  It  is  possible  to  estimate  it. 
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3.4  Distributed  Controller  Design  for  General  Dynam¬ 
ical  Systems 

Consider  m  systems  where  the  j-th  system  is  defined  by 

Q*j  fJ  1  j  ^  1  j  •  •  •  +  Qsj^sj  9*j^*j  (3.50) 

MjV^j  +  CjV*j  +  Gj  +  Dj  =  BjTj  (3.51) 

where  v*j  =  [vi j,  j]T,  gij,  . . . ,  gSj  are  smooth  functions  on  Rn  such  that  in  a  neighborhood 
of  0  the  dimension  of  the  distribution  A j(q*j)  =  Span{g(q*j)  :  g  G  Lie{gij, . . .  ,gSj}}  is  n- 
The  following  properties  are  satisfied. 

Property  3.3.  Mj  is  bounded  and  M j  —  2 Cj  is  skew- symmetric. 

Property  3.4.  For  any  differentiable  vector  f  G  R2, 

Mjf  T  Gj£  T  Gj  Y(X*j,  f,  f,)^j 

where  Yj  is  a  known  function  ofx*j,  x*j,  f,  and  f,  and  aj  is  the  inertia  parameter  vector. 
The  problem  considered  in  this  section  is  defined  as  follows. 

Consensus  of  Multiple  Systems:  For  a  group  of  m  systems  in  (3.50)-(3.51),  the  prob¬ 
lem  is  how  to  design  a  distributed  control  law  t3  for  system  j  based  on  its  own  information 
and  its  neighbors’  information  such  that 

hm  (g*j  —  c)  =  0,  1  <  j  <  m,  (3.52) 

where  c  is  an  unprescribed  constant  vector  which  depends  on  the  initial  condition  of  each 
system  and  the  topology  of  digraph  Q. 

In  the  dynamics  (3.51),  we  first  assume  that  the  inertia  parameter  vector  aj  is  a  constant 
and  is  unknown. 

In  order  to  design  controllers,  we  let 

Vij  =  Vij  -  1  <  j  <  s  (3.53) 

where  rpj  is  defined  in  (3.26)-(3.27),  respectively.  Then  we  have 

z*j  =  —  e*j  +  gijhij  +  •  •  •  +  9sjVSj  (3.54) 

Mjigj  +  CjV*j  =  BjTj  —  (Mjfi'j  +  CjT]*j  +  Gj  +  Dj)  (3.55) 

For  the  dynamics  of  each  system,  we  have 

MjT)*j  +  CjT]*j  +  G3  =  Y3{  *  j  5  £*j  •)  V*j,V*j)aj  (3.56) 

where  aj  is  the  inertia  parameter.  For  the  disturbance  Dj,  it  is  assumed  that 

ll-Djll  <  Pj(x*j)  (3.57) 

where  pj  is  a  known  function  of  q*j .  If  the  inertia  parameter  aj  is  a  constant  and  is  unknown, 
we  have  the  following  results. 
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Theorem  3.5.  For  the  m  systems  in  (3.50)-(3.51),  if  the  communication  graph  has  a  span¬ 
ning  tree,  the  control  law 


Ti  =  Bj 


-1 


—KjV*j  +  Yjhj  -  PjSign.(v*j)  -  Aj 


hj  —  r jYj  v*j 


(3.58) 

(3.59) 


ensures  that  hj  is  bounded  and  (3.52)  holds,  where  Kj  and  Tj  are  positive  constant  matrices, 
and 


A? 


Jfi=l  eij[dlj\i 
Si=l  eij  [ 9sj]i 


where  [•]*  denotes  the  i-th  element  in  [•]. 
Proof:  Let 


n 

v  =  Y.iCzi, 

i=  1 


57  ^  -(aj  -  aj)T 

.7=1  Z  .7  =  1  Z 


7X( 


(3.60) 


Differentiating  it  along  the  closed-loop  system,  we  have 


n  m  m  m 

v  =  -  57  z!X2Zi*  -  57  vjjKjVtj  -  57  pjuJsign(u*j)  -  57  A  A 

i=l  j= 1  j= 1  j= 1 

n  m 

<  -  57  aAA*  -  57  vJjK&j 

i= 1  j=l 


By  integrating  both  sides  of  the  above  inequality,  it  can  be  shown  that  V  is  bounded,  which 
means  that  s**,  and  hj  are  bounded.  Furthermore,  it  can  be  shown  that  by  Barbalat’s 
lemma  that  and  v*j  converge  to  zero.  Therefore,  (3.29)  holds.  ■ 

In  Theorem  3.5,  the  unknown  inertia  parameter  is  estimated  by  an  adaptive  control  law. 
If  an  estimate  of  aj  is  hj  and 

II aj  ~  hj ||  <  7? 

for  1  <  j  <  m  and  7 j  is  a  known  constant,  we  propose  the  following  robust  control  laws. 

Theorem  3.6.  For  the  m  systems  in  (3.50)-(3.51),  if  the  communication  graph  has  a  span¬ 
ning  tree,  the  control  law 


=  B 


-1 


-KjV*j  +  YjOj  -  7jY)sign(Y-  v+f)  -  pJsign(h*J)  -  A 


(3.61) 


ensures  that  (3.52)  holds,  where  Kj  is  a  positive  constant  matrix  and  Aj  is  defined  in  (3.60). 


Proof:  Let 


n 

i= 1 


m  2 

57  ~vJjMjV*j 

i= 1  z 


J 
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Differentiating  it  along  the  closed-loop  system,  we  have 

n  m  m  m 

Vj  <  Y  zJ*£2Zi*  -  Y  vJjKjV*j  -  Y  PjvJjSign&j)  -  Y  v~*jDj 

i=  1  3= 1  j=l  i=1 

m  m 

+  Z  vJjYjiaj  -  aj)  -  Y  IjV J^sign(^Tv*j) 
j= 1  i=1 

n  m 

<  -  E  z££2Zi*  ~  Y  <  0 

*=i  j=i 

Therefore,  V  is  bounded,  which  means  that  z j*  and  are  bounded.  By  Barbalat’s  lemma, 
it  can  be  shown  that  Zj*  and  v*j  converge  to  zero.  ■ 

In  Theorem  3.6,  the  unknown  inertia  parameter  aj  is  not  required  to  be  a  constant.  In 
the  control  laws,  7 j  is  required  to  be  known.  It  is  possible  to  estimate  it. 

3.5  Simulation 

To  verify  the  proposed  results,  simulation  has  been  done  for  three  nonholonomic  wheeled 
mobile  robots  on  a  horizontal  plane.  Robot  j  is  constituted  by  a  rigid  trolley  equipped  with 
3  nondeformable  wheels.  The  orientation  of  the  2  wheels  with  respect  to  the  trolley  is  fixed, 
while  the  orientation  of  the  third  wheel  is  varying.  See  Fig.  3.1  for  details.  We  assume 
the  plane  of  each  wheel  remains  vertical  and  the  wheel  rotates  around  its  (horizontal)  axis. 
The  contact  between  the  wheels  and  the  ground  satisfies  non  slipping  condition.  The  mobile 
robot  is  driven  by  2  motors  which  provide  torques  acting  on  the  rotational  axes  of  the  2 
wheels  whose  orientation  is  fixed. 

The  constraint  of  the  non  slipping  condition  can  be  written  as 

Xj  sin  9j  —  cos  9j  =  0  (3.62) 
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where  ( Xj,yj )  is  the  position  of  robot  j  and  Oj  is  the  orientation  of  robot  j.  The  dynamics 
of  robot  j  are  described  by  the  following  differential  equations 


rrijXj 
<  VtljXjj 

hh 


\j  cos  Qj  +  —  (tij  +  T2j)  cos  Oj 

Kj 


Xj  sin  6j  +  —  (tij  +  r2j)  sin  Oj 


L± 

Rj 


(T1  j  ~  T2 j) 


(3.63) 


where  rnj  is  the  mass  of  robot  j,  and  Ij  is  its  inertia  moment  around  the  vertical  axis  at 
point  Q.  Rj  is  the  radius  of  the  wheels  and  2 Lj  the  length  of  the  axis  of  the  front  wheels, 
and  T\j  and  r-2j  are  the  torques  provided  by  the  motors. 

Let  <?*j  =  [xj,yj,6j]r, 


Mj{q*j)  = 


Rj 


0 

0  ' 

m3 

0 

,Cj 

0 

Ij. 

cos  Oj 

cos  Oj 

sin  Oj 

sin  Oj 

Lj 

Lj  \ 

,  Cj {q*j ,  )  0,  Gj{q*j)  0 


,  Jj  =  [sin  Oj,  —  cos  Oj ,  0] 


The  system  (3.62)-(3.63)  is  in  the  form  of  (3.1)-(3.2). 
Let 

cos  Oj  0 
g*j  =  sin  Oj  0 
0  1 

then  Equation  (3.62)  and  (3.63)  are  converted  into 


With  the  transformation 


< 


'  Ij 

=  Uy  cos  Oj 

Vj 

=  U\j  sin  Oj 

0, 

=  U2  j 

mjulj 

=  ~jr(n  j  +  T2j) 

itj 

r  J 

IjU2j 

=  -  T2j) 

Kj 

xi  j  = 

x2j  =  Xj  cos  Oj  +  Uj  sin  Oj 
x3j  =  —Xj  sin  Oj  +  yj  cos  Oj 

ylj  =  ~U2j 

V2j  U'lj 


(3.64) 
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Equation  (3.64)  can  be  converted  into  the  following  standard  form 


f  Xu  =  Vij 
I  ±2  j  =  v2j 

I  = 

{  MjV*j  +  CjV*j  =  BjT*j 


(3.65) 


where 


h  +  mjxlj 

A  = 

rrijX3jXsj  0 

,  B j  — 

1 

X3  j  H-  Lj  X3  j  Lj 

1 

Vo. 

co 

Vo. 

Vo. 

rrijX3j  0 

Rj 

1  1 

and 

Mj(q*j)£  +  Cj(q*j,  q*j)£,  =  Yj{q*j,  q*ji 


where  the  inertia  parameter  vector  eq  = 


Yj(q*j,q*ji£i£) 


[rrij,  Ij}T, 

+  .r3j.f  3/^1 

+  £2  + 


6 

0 


The  consensus  problem  of  the  kinematics  in  (3.65)  can  be  solved  with  the  aid  of  the 
results  proposed  in  Theorem  3.1.  The  controller  is  proposed  as 


vij  =  Vij  (3-66) 

Vi  j  =  -hx^  +  Cij  (3-67) 

Cij  =  -  X!  MCij  -  Cii)  -  KCij  ~a)  +  a  (3.68) 

i&Mj 

v2j  =  ri2j  (3.69) 

V2j  =  ~  aAz2j  -  z2 i)  (3.70) 

*e  Mj 


where  Aq  >  0,  aji  >  0,  b  >  0,  and  a  =  sin(14t),  z2j  =  x2j  +  /32j,  z 3j  =  x 3j-  +  /93j-  ,  /33j-  =  0, 
and  (32j  =  vijZ^j.  Figs.  3. 2-3. 4  show  the  time  response  of  aq*,  x2 *,  and  x3* ,  respectively.  It 
is  shown  that  the  state  of  three  systems  reach  consensus. 

The  consensus  problem  of  the  dynamics  in  (3.65)  can  be  solved  with  the  aid  of  the  results 
in  Theorem  3.3.  The  controller  is  proposed  as  in  (3.6)-(3.48)  if  the  inertia  parameter  vector 
oq  is  a  constant  and  is  unknown.  Figs.  3. 5-3. 7  show  the  time  response  of  aq*,  x2 *,  and  a;3*, 
respectively.  It  is  shown  that  the  state  of  three  systems  reach  consensus. 

If  the  inertia  parameter  vector  cq  is  a  constant  and  is  unknown,  we  can  also  solve  the 
consensus  problem  by  the  robust  control  algorithms  in  Theorem  3.4.  Figs.  3.8-3.10  show  the 
time  response  of  aq*,  x2 *,  and  a;3*,  respectively.  It  is  shown  that  the  state  of  three  systems 
reach  consensus. 
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Figure  3.2:  Response  of  xi*. 


Figure  3.3:  Response  of  x 2*. 
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Figure  3.4:  Response  of  X2 *. 


Figure  3.5:  Response  of  xi*. 
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Figure  3.6:  Response  of  £2*. 
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Figure  3.7:  Response  of  £2*- 
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Figure  3.8:  Response  of  xi*. 


Figure  3.9:  Response  of  x 2*. 
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Figure  3.10:  Response  of  x 2*. 


Chapter  4 

Distributed  Tracking  Control  of 
Networked  Chained  Systems 

4.1  Introduction 

In  the  last  decades,  control  of  nonholonomic  systems  had  been  an  active  research  area.  An 
important  feature  of  a  nonholonomic  system  is  that  the  number  of  its  inputs  is  less  than  the 
number  of  its  degree  of  the  freedom.  This  feature  makes  control  problems  of  a  nonholonomic 
systems  challenging.  In  [9],  it  has  shown  that  there  does  not  exist  a  pure-state  feedback 
control  law  for  a  nonholonomic  system  such  that  its  state  converges  to  its  equilibrium. 
However,  with  the  effort  of  many  researchers  several  types  of  stabilizing  control  laws  have 
been  proposed,  for  example,  discontinuous  control  laws  in  [10]  and  [11],  time- varying  control 
laws  in  [12]  and  [13],  hybrid  control  laws  in  [14]  and  [15].  Tracking  control  of  a  nonholonomic 
system  has  also  been  extensively  studied  in  the  last  decades  due  to  its  applications  in  tracking 
control  of  wheeled  mobile  robots  and  unmanned  aerial  vehicles.  With  the  effort  of  different 
researchers,  several  tracking  controllers  have  been  proposed.  The  first  tracking  controller 
was  proposed  in  [16]  for  a  mobile  robot.  With  the  aid  of  backstepping  techniques,  semi- 
global  tracking  controllers  are  proposed  for  a  chained  form  system  in  [17].  In  [11],  global 
state  and  output  tracking  controllers  are  proposed  for  chained  form  systems  with  the  aid  of 
Lyapunov  techniques.  With  the  aid  of  results  on  cascade  systems,  linear  tracking  controllers 
are  proposed  for  chained  form  systems  in  [18]. 

Recently,  cooperative  control  of  multiple  systems  has  become  an  active  research  area  and 
has  attracted  multi-disciplinary  researchers  in  a  wide  range  of  fields,  including  control  system 
theory,  physics,  biology,  applied  mathematics,  computer  science,  and  robotics.  In  the  past 
decade,  most  of  researchers  focused  their  research  on  cooperative  control  of  multiple  identical 
linear  systems  or  multiple  specific  mobile  robots  with  simplified  identical  kinematic  models. 
Various  control  strategies  have  been  proposed,  such  as  the  behavior-based  method  in  [19] 
and  [20],  the  virtual  structure  method  in  [21]  and  [22],  the  leader- follower  method  in  [23] 
and  [24],  the  artificial  potentials  method  in  [25]  and  [26],  and  the  graph  theoretical  method 
in  [27]  and  [28],  to  name  a  few.  In  cooperative  control,  consensus  seeking  plays  an  important 
role  (see  [29]  and  [30]).  Many  cooperative  control  problems  can  be  solved  with  the  aid  of 
consensus  algorithms  or  techniques  developed  for  solving  the  consensus  seeking  problem. 
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These  cooperative  control  problems  include  collective  behavior  of  flocks  and  swarms,  sensor 
fusion,  formation  control  of  multiple  robot  systems,  synchronization  of  coupled  oscillators, 
etc.  In  [31],  alignment  of  multiple  discrete-time  agents  is  discussed  and  control  laws  are 
proposed  by  using  local  information.  In  [32] ,  a  theoretical  analysis  of  the  consensus  property 
of  the  Vicsek  model  is  presented  with  the  aid  of  results  from  algebraic  graph  and  matrix  the¬ 
ories.  For  networked  continuous-time  systems,  a  theoretical  framework  for  consensus  control 
problems  is  introduced  in  [33].  In  [34],  the  results  obtained  in  [32]  and  [33]  are  extended 
In  addition  to  the  algebraic  graph  approach  for  linear  systems,  nonlinear  analysis  tools  can 
also  be  used  to  study  consensus  algorithms.  In  [35],  a  set- valued  Lyapunov  approach  is  pro¬ 
posed  to  design  consensus  algorithms  with  uni-directional  time-dependent  communication 
links.  In  [36],  nonlinear  contraction  theory  is  used  to  study  synchronization  and  schooling 
applications.  In  [37],  passivity  is  applied  to  design  consensus  algorithms  over  an  undirected 
communication  topology.  In  [38]  and  [39],  consensus  algorithms  are  proposed  for  nonlinear 
systems  with  the  aid  of  Lyapunov  techniques.  In  [40] ,  consensus  algorithms  are  proposed  for 
high-order  nonlinear  systems  with  the  aid  of  backstepping  techniques. 

Distributed  tracking  control  of  multiple  systems  with  a  reference  system  whose  state  is 
available  to  a  subset  of  a  group  of  the  systems  is  an  important  cooperative  control  problem. 
This  cooperative  control  problem  is  also  referred  to  as  a  consensus  control  problem  of  multiple 
systems  with  a  reference  system.  Different  from  the  consensus  seeking  problem  reviewed 
above  the  desired  value  of  the  state  of  each  system  is  defined  by  the  state  of  a  reference 
system.  Extensive  research  on  distributed  tracking  control  problem  has  been  conducted 
for  multiple  linear  systems  in  the  past  decade  and  some  results  have  been  obtained.  In 
[41,42],  tracking  control  of  multiple  first-order  linear  systems  with  a  reference  system  is 
discussed.  Distributed  controllers  are  proposed  with  the  aid  of  distributed  estimators.  In 
[43]  and  [44],  distributed  tracking  control  is  considered  for  multiple  first-order  and  second- 
order  systems.  Distributed  discontinuous  controllers  are  proposed  such  that  the  state  of 
each  system  converges  to  a  desired  trajectory  within  finite  time  under  the  condition  that 
the  desired  trajectory  is  available  to  a  portion  of  the  group  of  systems.  Distributed  tracking 
control  of  multiple  Lagrangian  mechanical  systems  is  considered  in  [39]  and  distributed 
tracking  controllers  are  proposed. 

Flocking  and  synchronization  of  multiple  systems  can  be  considered  as  a  distributed 
tracking  control  problem.  In  [45],  flocking  of  multiple  second-order  systems  is  solved  with 
the  aid  of  potential  functions  under  the  assumption  that  a  desired  trajectory  is  available 
to  each  system.  In  [46],  flocking  of  multiple  systems  is  discussed  for  fixed  and  switching 
communication  cases  such  that  the  velocities  of  the  systems  reach  an  agreement.  In  [47]  and 
[48],  flocking  algorithms  of  multiple  second-order  linear  systems  are  proposed  under  the  as¬ 
sumption  that  the  information  of  a  virtual  leader  is  available  to  a  portion  of  systems.  In  [49] 
and  [50],  distributed  adaptive  control  for  synchronization  of  unknown  nonlinear  networked 
systems  is  considered.  Distributed  adaptive  control  laws  are  proposed  with  the  aid  of  neural 
network  approximation  such  that  the  tracking  error  is  uniformly  ultimately  bounded  (UUB). 
In  [51],  adaptive  leader-following  control  for  multiple  systems  with  uncertainties  is  consid¬ 
ered  with  the  aid  of  neural- networks.  Adaptive  control  laws  are  proposed.  In  [52],  formation 
control  of  multiple  wheeled  mobile  robots  is  considered  using  neighbors’  information.  Dis¬ 
tributed  controllers  are  proposed  with  the  aid  of  a  transformation  based  on  backstepping 
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techniques. 

In  this  chapter,  we  consider  distributed  state  feedback  tracking  control  and  distributed 
output  feedback  tracking  control  for  multiple  nonholonomic  chained  form  systems  with  a 
reference  system  whose  state  is  available  to  a  subset  of  the  group  of  systems.  Consider¬ 
ing  the  cascade  structure  of  each  system,  distributed  state  feedback  tracking  controllers  are 
proposed  in  two  steps  with  the  aid  of  the  results  of  time-varying  linear  systems  and  the 
properties  of  persistently  excited  signals.  In  the  first  step,  a  distributed  control  law  is  de¬ 
signed  for  the  first  input  of  each  system  with  the  aid  of  distributed  estimator  design  and 
the  sliding  mode  control.  In  the  second  step,  a  distributed  control  law  is  designed  for  the 
second  input  with  the  aid  of  linear  time-varying  theory  and  distributed  estimator  design. 
The  proposed  distributed  tracking  controllers  ensure  that  the  tracking  errors  uniformly  ex¬ 
ponentially  converge  to  the  state  of  the  reference  system.  If  the  state  of  each  system  is  not 
measurable,  distributed  output  feedback  tracking  controllers  are  proposed  by  integrating 
observer  design  to  the  proposed  distributed  state  feedback  tracking  controller  design.  The 
proposed  distributed  output  feedback  tracking  controllers  can  ensure  that  the  tracking  errors 
uniformly  exponentially  converge  to  zero.  In  literature,  distributed  tracking  control  was  con¬ 
sidered  for  multiple  linear  systems.  In  this  paper,  we  consider  distributed  tracking  control  of 
multiple  chained  form  systems  which  represent  wheeled  mobile  robots  and  unmanned  aerial 
vehicles  and  propose  distributed  tracking  controllers.  The  proposed  results  can  be  applied 
to  solve  the  formation  control  problem  of  wheeled  mobile  robots.  Simulation  results  verify 
the  effectiveness  of  the  proposed  results. 

The  remaining  parts  of  this  chapter  are  organized  as  follows.  In  Section  4.2,  the  problems 
considered  in  this  article  are  defined  and  some  preliminary  results  are  presented.  In  Section 
4.3,  distributed  state  feedback  tracking  controllers  are  proposed.  In  Section  4.4,  distributed 
output  feedback  tracking  controllers  are  proposed.  In  Section  4.5,  simulation  results  are 
presented.  The  last  section  concludes  this  article. 

4.2  Problem  Statement  and  Preliminary  Results 

4.2.1  Problem  Statement 

Consider  m  identical  nonholonomic  chained  form  systems.  The  j'-tii  system  is  described  by 


Qij  =  Uij  (4.1) 

<?2  j  =  u2j  (4.2) 

qij  =  q-i-ijUij,  3  <i  <  n  (4.3) 

Vj  =  [qij,qnjV  (4.4) 


where  q*j  =  [q\j, . . .  ,qnj]T  and  u*j  =  [tiy,  u2j\T  are  the  state  and  input  of  system  j,  respec¬ 
tively.  yj  is  the  output  of  system  j. 

The  communication  between  the  systems  can  be  described  by  the  edge  set  £  of  a  directed 
graph  (or  digraph  for  short)  Q  =  (V,  £}  where  the  m  systems  are  represented  by  the  m 
nodes  in  V.  The  existence  of  an  edge  (l,j)  G  £  means  that  the  information  (the  state  or 
output)  of  system  l  is  available  to  system  j  for  control  (i.e.,  unidirectional  communication). 
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Bidirectional  communication,  if  it  exists,  would  be  represented  by  the  edge  (j,  l )  also  being 
in  the  edge  set  £.  The  symbol  Afj  denotes  the  neighbors  of  node  j  and  is  a  set  of  indices  of 
the  systems  whose  information  is  available  to  system  j.  A  directed  path  in  a  digraph  is  an 
ordered  sequence  of  vertices  such  that  any  ordered  pair  of  vertices  appearing  consecutively 
in  the  sequence  is  an  edge  of  the  digraph.  A  digraph  is  called  strongly  connected  if  for  any 
two  different  nodes  i  and  j  in  V  there  exists  a  directed  path  from  node  i  to  node  j. 

It  is  given  a  desired  trajectory  <2ym+1  =  [qi,m+ 1,  •  •  •  ,qn,m+ i]T  which  is  generated  by  the 
reference  system 

Ql,m+ 1  Q2,m+ 1  U 2,m+l)  Qi,m+ 1  Qi—  l,m+l^l,m+l >  3  A  f  A  Dm+ 1  Q*,m+ 1 

(4-5) 

where  and  ^m+i  are  known  time-varying  functions.  The  desired  trajectory  is  avail¬ 

able  to  a  portion  of  the  group  of  m  systems.  For  simplicity,  the  reference  system  (4.5)  is 
denoted  as  system  (m  +  1).  The  m  systems  in  (4.1)-(4.4)  and  the  reference  system  in  (4.5) 
can  be  considered  as  a  group  of  (m  +  1)  systems  and  the  communication  between  (m  +  1) 
systems  is  denoted  by  the  digraph  Qe  =  {Ve,£e}.  The  neighbor  set  of  node  j  is  denoted 
by  Aff.  Since  the  reference  system  does  not  receive  information  from  other  systems,  the 
neighbor  set  of  node  (m  +  1)  is  an  empty  set,  i.e. ,  Afff+1  =  0-  Node  (m  +  1)  is  reachable  to 
node  j  if  there  exists  a  directed  path  from  node  (m  +  1)  to  node  j.  Node  (m  +  1)  is  said  to 
be  globally  reachable  if  node  (m  +  1)  is  reachable  to  node  j  for  1  <  j  <  m. 

The  cooperative  control  problems  that  will  be  discussed  in  this  article  are  defined  as 
follows. 

Problem  1:  (Distributed  state  feedback  tracking  control)  For  m  systems  in  (4.1)-(4.3) 
and  a  reference  system  in  (4.5),  the  control  problem  is  how  to  design  a  control  law  u*j  for 
system  j  using  its  own  state  q*j  and  its  neighbor’s  state  q*i  for  l  G  Afj  such  that 

lirn  (q*j(t)  -  q*,m+1(t))  =  0  (4.6) 


for  1  <  j  <  m. 

Problem  2:  (Distributed  output  feedback  tracking  control)  For  m  systems  in  (4.1)-(4.3) 
and  a  reference  system  in  (4.5),  the  control  problem  is  to  design  a  control  law  u*j  for  system 
j  using  its  own  output  i/j  and  its  neighbor’s  output  yi  for  l  G  Afj  such  that  (4.6)  is  satisfied 
for  1  <  j  <  ru¬ 
in  Problem  1,  the  state  of  each  system  is  available  by  itself  and  is  broadcasted  to  its 
neighbors.  While  in  Problem  2  the  output  of  each  system  is  available  to  itself  and  is  broad¬ 
casted  to  its  neighbors.  In  both  problems,  the  desired  state  q*tm+i  is  only  available  to  a 
subset  of  a  group  of  the  systems,  which  make  the  tracking  control  problems  challenging. 
The  tracking  controller  design  procedure  for  tracking  control  of  a  single  system  in  literature 
cannot  solve  Problems  1-2  because  the  information  of  the  reference  system  is  not  available 
to  each  system.  In  this  paper,  distributed  tracking  controllers  are  proposed  with  the  aid  of 
neighbors’  information. 

For  the  reference  system,  the  following  assumption  is  made. 

Assumption  4.1.  For  the  reference  system  (f.5),  u i ;m+ 1 ,  and  are  bounded. 

Moreover,  Mi,m+i  is  an  absolutely  continuous  PE  signal. 
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4.2.2  Preliminary  Results 

Throughout  this  article,  1 1  -  1 1 2  stands  for  the  Euclidean  norm  of  vectors  and  induced  norm 
of  matrices.  We  denote  by  Br  the  open  ball  Br  :=  {a;  G  :  ||a;||2  <  r}.  A  function 
a  :  9fH>o  — >  9ft>o  is  said  to  be  of  class  1C  (a  G  1C),  if  it  is  continuous,  strictly  increasing 
and  zero  at  zero.  If  moreover  a(s)  — *  00  as  s  — *  00  we  say  that  a  G  /C^.  The  origin  of 
the  system  x  =  f(t,x )  is  globally  uniformly  stable  (GUS)  if  there  exists  a  G  IC^  such  that 
||x(f) 1 1 2  <  adl^olh)  f°r  all  f  >  f0  and  all  f0  >  0.  It  is  uniformly  globally  asymptotically 
stable  (UGAS)  if  in  addition  to  UGS,  for  each  r  and  e  >  0,  there  exists  T(r,  e)  >  0  such  that 
(f o,xo)  G  9ft>o  x  Br  implies  that  ||a;(t) H2  <  e  for  all  t  >  t0  +  T.  The  origin  of  the  system  is 
said  to  be  globally  uniformly  exponentially  stable  (GUES)  if  there  exist  two  strictly  positive 
constants  71  and  y2  such  that 


\x(t,t0lx0)\\2  <  TiUxolbe  72(f  *o) 


for  any  initial  condition  Xo(to)  and  t  >  1 0  A  function  (p{t )  G  3ft  is  said  to  be  persistently 
excited  (PE)  if  there  exist  fi  >  0  and  T  >  0  such  that 

I  0(r)^dr  >  /i,  Vt  >  0. 

The  following  lemmas  are  useful  in  this  paper. 

Lemma  4.1.  For  a  linear  time-varying  system 
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(4.7) 


where  Ci  (1  <  i  <  l)  are  positive  constants,  if  0(f)  is  an  absolutely  continuous  PE  signal  and 
max;:e[o)OO){|0(f)|,  |0(f) | }  <  0m  <  00  almost  everywhere,  then  the  system  (4-V  is  GUES. 

Lemma  4.1  is  a  modified  version  of  Theorem  2  in  [53]  and  can  be  proved  similarly  (see 
Remark  1  in  [54]).  So,  the  proof  of  Lemma  4.1  is  omitted  here  for  space  limitation. 

Lemma  4.2.  For  a  linear  tune-varying  system 
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where  mod(l,2)  denotes  the  remainder  of  the  Euclidean  division  of  l  by  2,  and  constants  ct 
(1  <  i  <  l)  are  chosen  such  that  the  polynomial 

\l  +  C\\m  1  +  •  •  •  +  q_iA  +  Ci  (4-9) 


is  Hurwitz  (i.e.  all  roots  are  in  the  left  half  of  the  open  complex  plane) ,  if  (fit)  is  an  absolutely 
continuous  PE  signal  and  maxte[O)Oo){|0(OI>  [0(0 1 }  <  4>m  <  oo  almost  everywhere,  then  the 
system  (4-8)  is  GUES. 

Proof:  Let  x  —  [xi>  X2,  ■  ■  ■ ,  X/]T>  the  system  can  be  written  as 


x  =  0(0 


-Cl 

-c2 

— C3 

— Q— 1 

~Cl 
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(4.10) 


Define  the  Hurwitz  determinants 
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(4.11) 


where  if  an  element  c3  appears  in  Aj  with  j  >  i  it  is  assumed  to  be  zero.  It  is  well-known 
that  the  determinants  A*  are  all  positive  if  and  only  if  (4.9)  is  Hurwitz  ([55]).  Define 


71  =  Ax  =  ci,  72 


A-2 

a7’  73 


A3  _  Ai_3Aj 

AiA2  '  ^  Aj_2  Aj_i 


/  —  1.  5, 


(4.12) 


it  has  proved  in  [56]  and  [18]  that  there  exists  a  nonsingular  constant  matrix  P  e  Rlxl  such 
that 
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The  state  transformation  z  =  P\  transforms  system  (4.10)  into 
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Since  0  is  a  PE  signal  and  maxte[OjOO){|0(£)|,  |0(£)|}  <  4>m  <  oo  almost  everywhere,  by 
Lemma  4.1  system  (4.13)  is  GUES.  Noting  the  transformation  matrix  P  is  a  nonsingular 
matrix,  system  (4.10)  is  GUES.  ■ 

Lemma  4.3.  For  the  system 


x  =  ( A(t)  +  F(t))x  (4.14) 

if  Aft)  and  Fft )  are  bounded,  x  =  Aft)x  is  GUES,  and  Fft)  exponentially  converges  to  zero, 
then  the  system  (4-M)  is  GUES. 

Proof:  Since  x  =  Aft)x  is  GUES  and  Aft )  is  bounded,  by  Theorem  7.8  in  [57] 

roo 

Q(t )  =  J  $A(cr,t)$A(a,t)da 

is  a  continuously  differentiable  symmetric  matrix  for  all  t  and  is  such  that 

rpl  <  Q(t )  <  r] 2I  (4.15) 

AT  (t)Q(t)  +  Qft)A(t )  +  Qft )  =  —I  (4.16) 

where  r)i  and  772  are  hnite  positive  constants,  and  <L (a,  t )  is  the  state  transition  matrix  of  the 
system  x  =  A(t)x.  By  (4.16),  we  have 

[Aft)  +  Fft)]TQ{t )  +  Q(t)[A(t)  +  Fft)]  +  Qft )  =  FT(t)Q(t)  +  Q(t)F(t )  -  /. 

Since  Qft)  and  Fft)  are  bounded  and  Fft)  exponentially  converges  to  zero,  there  exists  a 
hnite  time  t\  such  that  FT ft)Q{t)  +  Qft) Fft)  <  /,  which  means  that 

[^4(t)  +  Fft)]^ Qft)  +  Qft) [Aft)  +  Fft)]  +  Qft)  <  vl 

for  t  >  ti,  where  v  is  a  positive  constant.  For  time  t  G  [0,U)  the  state  x  is  bounded  because 

Aft)  and  Fft)  is  bounded.  By  Theorem  7.4  in  [57],  the  system  (4.14)  is  GUES.  ■ 

For  a  cascade  system 


x  =  f1(t,x)  +  g(t,x,y)y  (4.17) 

y  =  f2{t,y)  (4.18) 

where  x  G  Rni,  y  G  i?"2,  fi(t,x)  is  continuously  differentiable  in  ft,x)  and  f-zft^y),  g(t,x,y) 
are  continuous  in  their  arguments,  and  locally  Lipschitz  in  y  and  (x,y),  respectively,  the 
following  result  has  been  proved  in  [58]. 

Lemma  4.4.  The  cascade  system  (f.l7)-(4.18)  is  GUES  if  the  following  conditions  hold: 

1.  the  system  x  =  fi(t,x)  is  GUES; 

2.  the  function  gft,  x,  y)  satisfies 

\\g{t,x,y)\\2  <  0i(|M|2)  +  02(||j/||2)||a;||2 
for  all  t  >  to,  where  6\  and  02  are  continuous  nonnegative  functions; 
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3.  the  system  y  =  f2(t,  y)  is  GUES. 


For  the  digraph  Qe  with  a  weight  matrix  Ae  =  [%i](m+i)x(m+i)  (aji  >  0),  its  weighted 
Laplacian  matrix  £e  =  [L®J(m+ i)x(m+i)  is  dehned  as 

if  i  7^  j  and  i  G  Aff 

if  i  ±  j  and  i  (f  Aff  ,4  ^ 

if  i  =  j. 

For  the  digraph  Q  with  the  weight  matrix  A  which  is  formed  by  the  first  m  rows  and  the 
first  m  columns  of  Ae,  its  weighted  Laplacian  matrix  £  =  [Ljf\mxm  is  dehned  as 


C^jii 
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where  0  is  a  vector  with  element  zero, 


and 


£ 

jC 


e 

11 


e 

12 


C  +  diag  (Ce12) 

[^l,m+l/^l5  •  •  • 


%+l  fJ>r 


IT 


hj 


1,  if  node  m  +  1  is  available  to  node  j 
0,  otherwise 


(4.20) 


(4.21) 


(4.22) 

(4.23) 


(4.24) 


for  1  <  j  <  m,  and  cliag(£^2)  denotes  a  diagonal  matrix  with  the  diagonal  being  the  vector 

re 

M2' 

For  the  weighted  Laplacian  matrix  £e,  the  following  results  will  be  applied  in  this  paper. 

Lemma  4.5.  For  the  digraph  Qe  with  weighted  matrix  Ae  =  [ap](m+i)x(m+i)  ( M  >  0),  its 
weighted  Laplacian  matrix  Ce  is  defined  in  (4-19).  If  node  (m+  1)  is  globally  reachable,  then 

1.  £e  1  =  0  where  1  is  a  vector  with  element  1; 

2.  zero  is  a  simple  eigenvalue  of  £e  and  non-zero  eigenvalues  of  £e  all  have  positive  real 
parts; 

3.  —  Cevl  is  a  Hurwitz  matrix; 

4 ■  there  exists  a  positive  definite  diagonal  matrix  P  such  that  Q  =  PCevl  +  (£fx)TP  is  a 
positive  definite  matrix. 
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Proof:  The  results  in  (1)  is  obvious  clue  to  the  definition  of  the  weighted  Laplacian 
matrix.  The  results  in  (2)  was  proved  in  [59].  Noting  the  structure  of  £e,  The  results  in  (3) 
is  obvious.  By  Theorem  4.25  in  [38],  the  results  in  (4)  can  be  derived  from  the  results  in  (2). 

■ 

Lemma  4.6.  For  the  digraph  Qe  with  the  weight  matrix  Ae  =  [aji](m+i)x(m+i)  ( aji  >  0),  its 
weighted  Laplacian  matrix  is  defined  in  (4-19).  Consider  the  system 

£  =  “£n(f  -  fm+il)  -  P  sign  (^n(0  -  fm+il))  (4.25) 

where  C\x  is  defined  in  (4-22),  fm+\  €  R  is  a  differentiable  signal  and  |£m+i|  is  bounded,  p 
is  a  control  parameter,  if  node  {m  +  1)  is  globally  reachable,  (£  —  £m+il)  globally  uniformly 
exponentially  converges  to  zero,  where  p  is  chosen  such  that 

P  >  max  |fm+i(t)|.  (4.26) 

t£[  0,oo) 

Proof:  Let  f  =  (f  -  fm+1l)/p,  one  has 

£  =  ~Ceu£  ~  sign  (£^1)  -  p-'lL+i  (4-27) 

Let  z  =  C\f£,  then 

z  =  ~C\X z  -  -CnSign(z)  -  C^p^l^m+i  (4.28) 

Since  node  (m+1)  is  globally  reachable,  there  exists  a  positive  definite  matrix  P  =  diag(Pi,  P2, . . . ,  Pm) 
such  that  Q  =  PC\X  +  (£n)TP  is  a  positive  definite  matrix.  Choose  a  Lyapunov  function 
V  =  zT Pz  and  differentiate  it  along  the  solutions  of  (4.28),  one  has 

V  =  -zTQz-2zTPCeusign(z)-2zTPCeup-1l£m+1 

=  — ztQz  —  2 zT PC  sign(z)  —  2^TPdiag(£®2)  sign(z)  —  2zTPdiag(£f2)P_1l^m+i 
<  -zTQz  -  2zr Pdi&g(Ce12)  sign (2;)  -  2zTPdiag(£];2)p_1l£m+i 

where  C  is  defined  in  (4.20)  and  £1  =  0,  £i2  is  defined  in  (4.23).  In  the  above  equations, 
we  apply  the  fact  that  z1  PC  sign(z)  >  0.  Since  £m+i  is  bounded,  if  p  is  chosen  such  that 
(4.26)  is  satisfied,  then 

m 

zTPdiag(£®2)  sign(z)  +  zTPdiag(£^2)p_1l^m+i  >  ^  pjaj,m+ifJ>j\zj\p~1  (p  ~  |fm+i|)  >  (4.29) 

3= 1 

So, 

C  <  -zT Qz  <  -A min(Q)zTz  <  -Xm™(QK  (4.30) 

^ max  \*  ) 

Therefore,  V  is  bounded  and  exponentially  converges  to  zero.  So,  (£  —  £m+il)  globally 
uniformly  exponentially  converges  to  zero.  ■ 
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4.3  Distributed  State  Feedback  Tracking  Control 

In  order  to  solve  Problem  1,  we  consider  system  (4.1)-(4.3)  as  a  cascade  system  of  (4.1)  and 
(4.2)-(4.3).  System  (4.1)  is  a  first-order  linear  system.  For  distributed  tracking  control  of  m 
first-order  linear  systems,  we  have  the  following  results. 

Lemma  4.7.  For  m  systems  in  (4-1)  and,  the  reference  system  in  (4-5)  with  Assumption  4-1, 
if  node  (■ m  +  1)  is  globally  reachable  in  the  communication  digraph  Qe,  then  the  distributed 
control  laws 

a,\j  'y  )  Qii)  Qi,m+i)  T  £ij  (4.31) 

i£Afj 

£l  j  ^  £li)  ®j,m+lh'j(slj  £l,m+l) 

i&ATj 

P  sign  y> )  ^ii)  "F  ®jr,»n+ihi  ('Cij  £i,m+i)  (4.32) 

JGA fj 

for  1  <  j  <  m  ensure  that  q\j  globally  uniformly  exponentially  converges  to  q\,m+\  and  f\-j 
globally  uniformly  exponentially  converges  to  where  p  is  a  sufficiently  large  number, 

h,  i  ,m+ 1  a  i  .171-1-1 ,  and  a,ji  >  0. 

Proof:  The  m  systems  in  (4.32)  can  be  written  as 

6*  =  -£n(6*  -  6,m+il)  -  p  sign(£^(£i*  -  6,m+il))  (4.33) 

where  £i*  =  [£n,  £12,  •  •  • ,  ^im]T.  Since  node  (m+1)  is  globally  reachable  in  the  communication 
digraph  Qe ,  by  Lemma  4.6  (£ij  —  £i,m+i)  uniformly  exponentially  converges  to  zero  if  p  is 
chosen  such  that  p  >  maxte[0iOO)  |£i,m+i(t)|. 

Let  qij  =  qij  —  qi,m+i  and  qu  =  [<?n?  •  •  •  ,Qim]T,  with  the  control  law  (4.31)  we  have 

Qi*  =  —  Ai<?i*  +  fi*-  (4.34) 

System  (4.34)  can  be  considered  as  a  linear  system  subjected  to  disturbance  which  uniformly 
exponentially  converges  to  zero.  Since  node  (m+  1)  is  globally  reachable  in  the  communica¬ 
tion  digraph  Qe ,  by  Lemma  4.5  qu  uniformly  exponentially  converges  to  zero,  which  means 
that  ( q^  —  giim+i)  globally  uniformly  exponentially  converges  to  zero.  ■ 

With  the  aid  of  Lemma  4.7,  the  control  law  U2j  can  be  proposed  and  the  following  results 
can  be  obtained. 

Theorem  4.1.  For  m  systems  in  (4-l)-(4-3)  and  a  reference  system  (4-5)  with  Assumption 
4-1,  if  node  (m+1)  is  globally  reachable  in  the  communication  digraph  Qe,  then  the  distributed 
control  laws  (4-31)-(4-32)  and 


n 


u2j  = 

\ '  U  ,.mod{l, 2)  £ 

—  2^  Qij  +  S2 j 

1=2 

(4.35) 

iv  = 

^  aji(£,2j  ^2*)  aj^rnjr\Pj(fs2j  £2,m+l) 

i&Mj 

[d  sign  2  'j  aji(f2j  f,2i)  T  £2,771+1) 

(4.36) 

i£Afj 
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for  1  <  j  <  m  ensure  that  q *j  globally  uniformly  exponentially  converges  to  q*itn+i  and 
(£1 ji&j)  globally  uniformly  exponentially  converges  to  (£i,m+i,  £2,771+1)7  where  (3  is  a  suffi¬ 
ciently  large  number, 

£2,771+1  —  ^2,771+1  +  klQ2,m+l  +  &2'Wi,to+1?3,to+1  +  ^3^4, m+1  +  ‘  ‘  ‘  +  kn- 1^1,771+1’  ^  Qn,mi 4-37) 

and  ki  (\  <  l  <  n  —  1)  are  chosen  such  that  the  polynomial 

\n  1  +  k\\n  2  +  •  •  •  +  fcn_2A  +  kn—  i  (4.38) 


is  Hurwitz. 

Proof:  Define 


Si—i,j  ^  )  ajiiqij  qu)  4~  Ojjn^ \  pj ( qij  qi,m+i ) 


(4.39) 


ieA/i 


for  2  <  l  <  n  and  1  <  j  <  m,  the  closed-loop  systems  can  be  written  as 

n 

^  'MJl—  1  0 1  ,m,+ 1  lj  4“  ^  )  0,ji(fi2j  £2i)  4"  Ojj,m.+lPj  {£,2j  £2,m+l) 


Sij 


1=2 


i&Ni 


~Y.ki- 1 

1=2 


Eli  mod(l,2)  mod(l,  2)\  /  mod(l,  2)  mod(l,  2)\  \ 

Oji  ^l,m+l  )dlj  +lj  ^l,m+l  )dli J 


i£Afj 

.  /  modil,  2)  mod(l,2)\  \ 

~~  ^l,m+l  )9/jJ 

^1,777+1  ^lj  “1“  ^  y  &ji [92j> (^lj  ^l,m+l)  92i(^l7  ^l,m+l)] 

ieAfj 

(^lj  ^1,771+1)92^' 

^1,777+1^77— 2, j  ^  ^  ^7  [^77— l,ji  (^lj  ^l,777+l)  9t7—  1,2  (^ll  ^1,777+1 ) ] 


52j 


'->77— lj 


(4.40) 


iGAfj 


f,2j  =  ~  X/  aji{^2j  ~  £.2 i)  ~  Oj,77i+lAb'(£2j  ~  £2,771+1) 
is  A/",- 


—  (3  sign 


^  )  Oji{f,2j  £.2 i)  4"  GT;,77i+l/h/ (£2^  £2,771+1) 

ieA/i 


(4.41) 


9ii 

6, 


^  )  Oji (q\j  hi i)  0,j,m-\-lk'j  i,Qlj  l?l,77i+l)  £  1  j 

*6  AO 

^  )  ®ji(£lj  £li)  ®j,77i+l/fj  (£lj  £l,77i+l) 

ieMj 


— p  sign 


^  )  Qji(£lj  Sli)  +  G^TTi+lAb+lj  £1,771+1) 
i&Mj 


(4.42) 


(4.43) 
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Let  £2j  =  6j  -  6,rn+ 1,  A  =  qij  -  gi.m+1,  and  u±j  =  uX]  -  u1)Tn+1,  then  we  have 

n 

$lj  ^  l^l.rra-l-1  l,j  "h  ^  )  djii&j  £21)  4"  dj,m+lPj^2j 


1=2 

n 

E^- 1 

1=2 


ieAfj 
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^l,m+i  )Qlj  li  ^l,m+l  /9li J 


1  /  “l.m+l 

ieAT, 

mod(l,  2)  mod(l,  2) 


,  /  moau.z  moau,z)\ 

\tt\j  ^l,m+l  )Qlj 

£>2j  ^l,m+l^li  ^  v  Qjji(yQ2j'Ujlj  H“  Qjj,m-\-lfJjj'UjljQ2j 

ieAfj 

Sn-l,j  —  ^l,m+lSn-2,j  +  E  Q'jii.Qn—ljj'U'lj  Qn—lji^li)  4“  ^j.rn+ 1  PjH  {  /(In—  1  ,j 

ieAfj 


(4.44) 


^  '  ®;i(C2j  £,2 i)  (^j,m+lpj^2j  C2,m+1 


ieAfj 


—  (3  sign 


^  )  ^jii^,2j  C 2i )  4“  0>j,m+lPj^2j 


ieAfj 


Qlj  ^  '  Mtfl?  9li)  Q'j,m+ll-ijQlj  4”  Clj 


(4.45) 

(4.46) 
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Clj  ^  '  ®ji(Clj  Cli)  ^j,m+lPjClj  Cl, m+1 


ieAfj 


p  sign 


E  %*(Cij  Cn)  4~  djjm+lhjCl  j 

ieAfj 


(4.47) 


The  system  in  eqns.  (4.44)-(4.46)  for  1  <  j  <  m  can  be  considered  as  a  cascade  system 


(4.17)-(4.18)  with  X  =  .  ...  =  [[sn,  S21,  •  •  •  ,  «n-l,l],  •  •  *  ,  [«lm,  S2m,  ■  ■  •  ,  Sn-l, 


iT 


lT 


V  \y*l,  •  •  •  i  y*m .  .C2I)  Qll-i  Cll.  j  •  •  •  j  [C2mj  Ql mi  Cl m.  j  S*j  [®ljj  •  •  ■  )  ^n— l,j.  j 


—Ah 

feWl.m+l 

7  mod(n— 1,2) 

—  fcn_2Mi)m_(_i 

7  mod(n,  2) 

— /vn_iMljm+1 

^l,m+l 

0 

0 

0 

/«  = 

0 

^1,771+1 

0 

0 

0 

0 

n  1  ,m+l 

0 

lT 


lm 


A?  - 


^  ]  ®ji  (Cgj  &2i)  hjAj  P  sign 


i&V,- 


E  (C2j  —  C21)  +  ®j,m+lhjC2j 


ieA/-,- 


-A 


m+1 


)  )  djiiqij  Qli)  (,  j.rn+ 1  P  jQ I j  4”  C 1  j 

ieAfj 


^  )  ®j*(Cij  sn)  ®ij,m+iP,j^ij  ft  sign 
ieAfj 


E  aj*(Cij  -  Cn)  4-  ®j,m+l/^jClj 

ieAfj 


-Cl, 


m+1 
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fi  ($1  y)  —  [/21)  fiii  ■  ■  ■  1  /2m] 


-Efc»- 1 


1= 2 


E  aii  ((u‘ 


ieNi 


mod(l,2 ) 


tt 


mod(l,  2) 
l,m+l 


)®: 


(u 


mod(l,  2) 

li 


U 


mod(l,  2) 

l,m+l 


)®») 


(^lj 


mod(l,  2)  mod(l,  2) 
0,l,m+l 


— 


)%■  +  E  ^jiifilj  fh )  3~  Uj,rn+ 1  /UGl 


i&Mi 


9ij  = 


E Mwp'u  -  fefiii)  +  Q'j,m+ 1  y  j  ^  1  j  Q'2j 

*eA fj 


'y  )  Qjii.Qn—ljV'lj  Qn—lji^li)  “1“  ®  j  ,m+ 1  t^j  ^  lj  Qn—  1  ,j 
ieNj 


g(t,  x,  y)y  =  [ gn,gj2 ,  ■  ■  ■ ,  Em]T 

Since  node  (m  +  1)  is  globally  reachable  in  the  communication  digraph  £e,  by  the  proof 
of  Lemma  4.7  it  can  be  proved  that  £2j  globally  uniformly  exponentially  converges  to  zero. 
With  the  aid  of  the  proof  of  Lemma  4.7,  G*  and  qt*  globally  uniformly  exponentially  con¬ 
verge  to  zero,  respectively.  Therefore,  the  systems  in  (4.45)-(4.47)  are  globally  uniformly 
exponentially  stable,  which  means  that  y  =  fi(y)  is  globally  uniformly  exponentially  stable. 
Furthermore,  U\j  is  GUES. 

Since  is  a  PE  signal,  by  Lemma  4.2  the  system  x*j  =  f\j  is  GLIES.  So,  x  =  j\  (x) 

is  GUES. 

By  (4.39),  qy*  =  (£G)_lsz-i,*  +  lq;,m+i.  It  can  be  shown  that  \\g(t,x,y)\\2  <  di(\\yh)  + 
^2(||y||2)||^||2  where  9\  and  62  are  nonnegative  continuous  functions.  By  Lemma  4.4,  the 
system  (4.44)-(4.47)  is  GUES,  which  means  that  s^,  Gj>  and  Gj  globally  uniformly  expo¬ 
nentially  converge  to  zero  for  1  <  l  <  n  —  1  and  1  <  j  <  m.  By  (4.39),  s;_i,*  =  £hqi*,  where 
Qi*  =  Qi*  —  qi,m+ il-  So,  q)*  =  (>Cf2)-1Si_ii*.  Therefore,  q/*  globally  uniformly  exponentially 
converges  to  zero.  ■ 

In  the  distributed  control  laws  (4.31)-(4.32)  and  (4.35)-(4.36),  p  and  (3  should  be  chosen 
such  that 


p>  max  |G,m+1(t)|,  P>  max  |G,m+1(t)|.  (4.48) 

te[0,oo)  te[0,oo) 

Since  G,m+i  and  G,m+i  are  unknown  to  each  system,  the  lower  bounds  of  p  and  f3  in  (4.48) 
are  unknown  for  each  system.  Therefore,  p  and  (3  are  required  to  be  chosen  large  enough  in 
the  theorem. 

In  Theorem  4.1,  (4.36)  is  an  estimator  of  G,m+i  •  The  estimator  (4.36)  is  distributed. 
In  [52],  formation  control  of  wheeled  mobile  robots  is  considered  and  distributed  controllers 
are  proposed  using  backstepping  techniques.  In  this  paper,  we  considered  the  distributed 
tracking  control  problem  of  multiple  chained  form  systems  and  proposed  distributed  tracking 
controllers  with  the  aid  of  results  for  cascade  systems.  The  proposed  results  in  this  paper 
can  be  applied  to  solve  the  formation  control  problem  of  wheeled  mobile  robots  (see  Section 
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4.5).  In  [60],  cooperative  tracking  control  of  multiple  chained  systems  was  consider  under  the 
condition  that  a  desired  trajectory  is  known  to  each  system.  While  in  this  paper  cooperative 
tracking  control  problem  is  solved  under  the  condition  that  a  desired  trajectory  is  only 
available  to  a  portion  of  a  group  of  systems.  It  is  obvious  that  the  method  proposed  in  [60] 
cannot  solve  the  tracking  control  problem  considered  in  this  paper.  In  [60],  the  controllers 
were  designed  with  the  aid  of  backstepping  techniques  and  results  of  graph  theory.  In  this 
paper  distributed  tracking  controllers  are  designed  with  the  aid  of  the  cascade  structure  of 
each  system,  results  of  time-varying  systems,  and  results  of  graph  theory. 


4.4  Distributed  output  feedback  distributed  control 

In  the  last  section,  it  is  assumed  that  the  state  of  each  system  is  available  for  feedback  control. 
In  this  section,  it  is  assumed  that  the  output  of  each  system  is  available  for  feedback  control. 
In  order  to  solve  Problem  2,  we  build  an  estimator  for  each  system  to  estimate  the  state  of 
each  system  and  integrate  the  estimators  to  the  distributed  state  feedback  laws  proposed  in 
the  last  section. 

With  the  aid  of  Theorem  4.1  and  the  observer  design  theory  for  linear  time- varying 
systems  in  [61],  we  have  the  following  results. 

Theorem  4.2.  For  m  systems  in  (f.l)-(f.f)  an(4  the  reference  system  (4-5)  with  Assumption 
4-1,  if  node  (m+ 1)  is  globally  reachable  in  the  communication  digraph  Qe,  then  the  distributed 
control  laws  (f.31)-(f.32)  and 


n 


u2j  = 

\  '  U  -.mod(l, 2U  ,  c 

—  2^  Ki-iuij  qij  +  t,2j 

1= 2 

(4.49) 

4?  = 

^  '  ^ji{f,2j  £2*)  0Jj,m+lPj{fi2j  ^,2,m+l) 

ieW 

ft  sign  2  ^  ^2*)  T  ^j,m.+lhj{^2j  £,2,m+l) 

(4.50) 

i£Afj 


for  1  <  j  <  m  ensure  that  q*j{t)  globally  uniformly  exponentially  converges  to  q*)m+i(t)  and 
(fij,  f2j)  uniformly  exponeiitially  converges  to  (£i)m+i,  £2,771+1);  where  /3  is  a  sufficiently  large 
number,  and  qij  is  generated  by  the  estimator 
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k\ 

-k2uij 
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Ulj 
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7  modi  n— 2,2) 

7  modin— 3,2) 

t  mod(n— 4,2) 

^n— 3^1j 

1 

3°  0  ■■■ 

1 _ 

( qnj  qnj )  4“ 

I2U1] 

0 

h 

0 

constants  ki  and  lt  (1  <  i  <  n  —  1)  are  chosen  such  that  the  polynomials 

An_1  +  h\n~2  +  k2Xn~3  +  kn_2  X  +  kn_i 
A”"1  +  /1A"-2  +  l2  A”"3  +  /„_2A  +  in_i 


(4.51) 


(4.52) 

(4.53) 


are  Hurwitz. 

Proof:  Let  S/_ij  be  defined  in  (4.39),  qtj  =  qtj  -  qtj,  f2j  =  f2j  -  6,m+i  and  q±j  = 
qij  —  qi,m+i,  for  2  <  l  <  n  and  1  <  j  <  m,  the  closed-loop  systems  can  be  written  as 
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})®i) 


‘l,m+l  )®jJ  +  E^-l^gm+i  Qlj 
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4“  )  (  q2i  ^  1  i]  4-  O  j:rn+ 1  P  j  ^  1 7  q2j 
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qn—\  j  u  1  ,/7/+ 1  qn—2.j  +  lj2^j  1  ,m+ 1 qnj  4~  U\jqn—2  j  -4  l2U\  jqnj  (4.57 ) 

Qnj  ^l,m+l9ra— lj  4~  1 1  qnj  4“  U\jqn—\  j  (4.58) 
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_ieA0 

Q\ j  )  (  (tjiiqij  9li)  Uj,m,+ 1  hj h  1  j  4“  Slj  (4.60) 
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'y  '  ®ji(£ly  £li)  ®j,m+l/^,j£lj  £l,m+l 
iGAf-i 


-p  sign 


y  aji(€ij — iu)  +  ®j,m+l/^j£lj 

ieJVj 


(4.61) 


where  Wij  =  Mij  —  for  1  <  j  <  m. 

The  system  in  eqns.  (4.54)-(4.60)  for  1  <  j  <  m  can  be  considered  as  a  cascade  system 
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where  x  =  [x^, . . . ,  xJm]T  =  [[sn,  s2  i,  •  •  • ,  Sn-1,1],  •  •  • ,  [sim,  s2m,  •  •  • ,  sn_i,m]]  ,z  =  [zjlt . . . ,  zJm]T 
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Since  node  (m  +  1)  is  globally  reachable  in  the  communication  digraph  (?e,  by  the  proof 
of  Lemma  4.7  it  can  be  proved  that  Gj  globally  uniformly  exponentially  converges  to  zero. 
With  the  aid  of  the  proof  of  Lemma  4.7,  G*  and  G*  globally  uniformly  exponentially  con¬ 
verge  to  zero,  respectively.  Therefore,  the  systems  in  (4.59)-(4.61)  are  globally  uniformly 
exponentially  stable,  which  means  that  y  =  /^(y)  is  GLTES.  Furthermore,  it  can  be  shown 
that  U\j  uniformly  exponentially  converges  to  zero. 

Since  ,u1)m+1  is  an  absolutely  continuous  PE  signal,  with  the  aid  of  Lemma  4.2  and 
reordering  of  the  state  z  of  the  system  (i.e.,  reverse  the  order  of  the  state)  it  can  be  shown 
that  i  =  fs(t,  z )  is  GLIES.  Since  u\j  exponentially  converges  to  zero,  by  Lemma  4.3  the  state 
z  of  the  system  (4.63)  uniformly  exponentially  converges  to  zero. 

By  Lemma  4.2  the  system  x+j  =  j\3  is  GUES.  So,  x  =  fi(t,x )  is  GUES.  By  (4.39), 
Qi*  =  (£ii)-lsJ-i,*+ft,m+i-  It  can  be  shown  that  \\g(t,x,  z,y)\\  <  0i(||(j/,  z)||)+6>2(||(?/,  z)||)|M| 
where  Q\  and  d2  are  nonnegative  continuous  functions.  By  Lemma  4.4,  the  system  (4.54)- 
(4.61)  is  GUES,  which  means  that Gj,  and  Gj  globally  uniformly  exponentially  converges 
to  zero  for  1  <  l  <  n  —  1  and  1  <  j  <  m.  By  (4.39),  Si-i^  =  C\ , q/*  where  qu  =  9i*  ~  Qi,m+ il- 
So,  qu  =  (£f1)_1S;_ii*.  Therefore,  q/*  globally  uniformly  exponentially  converges  to  zero.  ■ 
In  Theorem  4.2,  (4.50)  is  an  estimator  of  G,m+ i,  which  is  the  same  as  that  in  Theorem  4.1. 
(4.51)  is  an  observer  of  state  [q2y ,  q$j,  ■  ■  ■ ,  qnj\T ■  Observer  (4.51)  is  proposed  with  the  aid  of 
the  observer  theory  for  linear  time- varying  systems  in  chapter  15  in  [61],  the  duality  property 
of  state  feedback  design  and  observer  design  for  linear  systems,  and  the  state  feedback  results 
in  Section  4.3.  (4.49)  is  a  tracking  controller  based  on  the  estimated  states. 
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4.5  Simulations 


To  verify  the  proposed  results,  simulation  has  been  done  for  formation  control  of  five  non- 
holonomic  wheeled  mobile  robots  on  a  horizontal  plane.  The  kinematic  of  robot  j  is 

ij  =  Vj  cos  9j,  ijj  =  Vj  sin  Oj,  9j  =  ujj  (4.65) 

where  ( Xj,i/j )  is  the  location  of  robot  j,  9j  is  the  orientation  of  robot  j,  Vj  and  t Oj  are  the 
control  inputs.  It  is  given  a  desired  formation  defined  by  a  geometric  pattern  V  whose 
vertexes  are  at  coordinate:  (pix,piy),  ( P2x,P2y ),  ( P3x,P3y ),  ( P4x,P4y ),  and  ( P5x,P5y )•  It  is  also 
given  a  desired  virtual  robot 

x6  =  v6  cos  9q,  y6  =  v6  sin  d6,  d6  =  cu6.  (4.66) 


The  formation  control  problem  of  five  mobile  robots  is  to  design  distributed  control  laws 
such  that 
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(4.69) 


The  formation  control  problem  can  be  solved  with  the  aid  of  the  results  proposed  in  the 
last  sections.  To  this  end,  we  define 


(l\j  —  Qj 

92 j  =  (xj  -  pjx )  cos  Oj  +  (yj  -  pjy)  sin  Oj 

'  Q3 j  =  {xj  -  pjx)  sinO j  -  (yj  -  pjy)  cos 9 j  (4.70) 

lllj  =  UJj 

^‘2j  Vj 

for  1  <  j  <  6,  where  p6x  =  p6y  =  0.  Then,  we  have 

qij  =  u  ij ,  q2j  =  u2j,  q-ij  =  uloq2]  (4.71) 


which  is  a  special  case  of  system  (4.1)-(4.3).  It  can  be  shown  that  the  formation  control 
problem  is  solved  if  (4.6)  is  satisfied  for  1  <  j  <  5.  Therefore,  the  proposed  distributed 
tracking  control  laws  in  the  last  sections  can  solve  the  formation  control  problem. 

In  the  simulation,  it  is  assumed  that  the  desired  formation  pattern  is  shown  as  in  Fig. 
4.1  and  the  state  of  the  reference  system  is  (x6,y6,96)  =  (10sin(0.5f),  — 10 cos(0.5f),  0.5f). 
If  the  state  of  each  system  is  available  for  feedback  control,  the  distributed  tracking  control 
laws  in  Theorem  4.1  solve  the  formation  control  problem.  Fig.  4.2  shows  the  communication 
digraph  between  systems.  Figs.  4. 3-4. 5  show  the  response  of  (qij  —  qie),  ( q2j  —  q2&),  and 
(qsj  —  q3$)  for  1  <  j  <  5,  respectively.  The  simulation  results  show  that  (4.6)  is  satisfied. 
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Figure  4.1:  Geometric  pattern  of  the 
formation 
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Figure  4.3:  Response  of  (q\3  —  q1&)  for 
1  <  i  <  5. 


Figure  4.4:  Response  of  (q2j  —  q2&)  for 
1  <  i  <  5. 


Fig.  4.6  shows  the  centroid  of  x*  (1  <  i  <  5)  (i.e. ,  X^=1Xj/5)  and  x6.  Fig.  4.7  shows  the 
centroid  of  y*  (1  <  i  <  5)  (i.e.,  J2j=iVj/ 5)  and  y§.  Fig.  4.8  shows  the  path  of  the  centroid 
of  the  five  robots  and  its  desired  path.  The  simulation  results  verify  that  (4.68)-(4.69)  are 
satisfied.  Eqn.  (4.67)  is  also  verified  and  the  response  of  them  is  omitted  here. 

If  the  output  qij  and  q3j  is  available  and  can  be  broadcasted  to  its  neighbors,  the  dis¬ 
tributed  output  tracking  laws  can  be  obtained  with  the  aid  of  Theorem  4.2.  It  is  assumed 
that  the  communication  digraph  and  the  state  of  the  virtual  system  are  the  same  as  before. 
Figs.  4.9-4.10  show  the  response  of  ( q2j  —  q2j )  and  (q3j  —  q3j)  for  1  <  j  <  5,  respectively.  The 
simulation  results  show  that  the  estimation  errors  converge  to  zero.  Figs.  4.11-4.13  show  the 
response  of  (q\3  —  qi6),  (q2j  —  q2e),  and  ( q3j  —  q3e )  for  1  <  j  <  5,  respectively.  The  simulation 
results  show  that  (4.6)  is  satisfied.  Fig.  4.14  shows  the  centroid  of  Xi  (1  <  i  <  5)  (i.e., 
Y^=iXj/5)  and  xq.  Fig.  4.15  shows  the  centroid  of  yi  (1  <  i  <  5)  (i.e.,  YJj=\  / 5 )  and  y§. 
Fig.  4.16  shows  the  path  of  the  centroid  of  the  five  robots  and  its  desired  path.  Simulation 
results  verify  that  (4.68)-(4.69)  are  satisfied.  Eqn.  (4.67)  is  also  verified  and  the  response  of 
them  is  omitted  here. 
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Figure  4.5:  Response  of  (q3j  —  g36)  for 
1  <  i  <  5. 


Figure  4.7:  Response  of  the  centroid  of 
Hi  (solid)  for  1  <  i  <  5  and  ye  (dashed). 


Figure  4.9:  Response  of  (q2j  —  Q2j)  for 
1  <  i  <  5. 


Figure  4.6:  Response  of  the  centroid  of 
Xi  (solid)  for  1  <  i  <  5  and  xq  (dashed). 


Figure  4.8:  The  path  of  the  centroid 
of  the  five  robots  (dashed  line),  the  de¬ 
sired  path  (solid  line)  of  the  centroid  of 
robots,  and  formation  of  the  five  robots 
at  several  moments  (red  pentagons). 


Figure  4.10:  Response  of  (q3j  —  q3j )  for 
1  <  i  <  5. 
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Figure  4.11:  Response  of  (qy  —  g16)  for 
1  <  i  <  5. 


Figure  4.12:  Response  of  (q2j  —  q2&)  for 
1  <  i  <  5. 


Figure  4.13:  Response  of  (q3j  —  g36)  for 
1  <  i  <  5. 


Figure  4.14:  Response  of  the  centroid 
of  Xi  (solid)  for  1  <  i  <  5  and  x6 
(dashed). 
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Figure  4.15:  Response  of  the  centroid 
of  yt  (solid)  for  1  <  i  <  5  and  ye 
(dashed). 


Figure  4.16:  The  path  of  the  centroid 
of  the  five  robots  (dashed  line),  the  de¬ 
sired  path  (solid  line)  of  the  centroid  of 
robots,  and  formation  of  the  five  robots 
at  several  moments  (red  pentagons). 


4.6  Conclusion 

This  chapter  discusses  the  distributed  tracking  control  of  multiple  nonholonomic  systems. 
Distributed  tracking  control  laws  are  proposed  with  the  aid  of  results  for  cascade  systems 
and  results  from  graph  theory.  Simulation  results  verify  the  proposed  results.  In  this  paper, 
we  assume  that  the  communications  between  systems  are  fixed.  If  the  communication  graph 
is  time-varying,  the  proposed  distributed  tracking  control  laws  also  solve  the  defined  control 
problem  if  the  communication  graph  is  bidirectional  and  strongly  connected  at  each  instant. 
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Chapter  5 


Leader-Following  Control  of  Multiple 
Nonholonomic  Systems  Over  Directed 
Communication  Graphs 

5.1  Introduction 

Distributed  cooperative  control  of  multiple  systems  has  been  extensively  studied  in  the  past 
decade.  The  focus  of  this  control  problem  is  on  the  cooperation  between  multiple  systems  by 
using  neighbors’  information.  The  interaction  among  systems  and  the  integrity  of  systems 
are  important.  One  of  fundamental  approaches  to  achieving  group  behavior  through  local 
information  is  to  make  a  function  of  the  state  of  each  system  agree  on  the  same  value  (i.e., 
reach  consensus).  The  problem  on  how  to  make  multiple  systems  come  into  a  consensus 
on  some  function  of  states  is  the  so-called  consensus  problem.  The  consensus  problem  has 
many  engineering  applications  in  practice,  such  as  formation  control  in  [62],  flocking  behavior 
analysis  in  [45],  attitude  alignment  in  [63],  etc. 

In  literature,  both  the  leaderless  consensus  problem  and  the  leader-following  consensus 
problem  have  been  studied  based  on  whether  or  not  there  is  a  leader  specifying  the  agree¬ 
ment  value.  In  the  early  research  work,  the  leaderless  consensus  problem  had  been  studied 
for  multiple  first-order  linear  systems  in  [32]  and  [33].  Extensions  of  the  results  in  [32]  and 
[33]  were  presented  in  [34],  In  [64]  and  [65],  the  leaderless  consensus  problem  of  multiple 
identical  linear  systems  was  considered  and  observer-based  output  feedback  controllers  were 
proposed  for  time-invariant  communication  topology.  For  the  leaderless  consensus  problem 
of  multiple  linear  systems  with  different  dynamics  paper  [66]  proposed  observer-based  dis¬ 
tributed  controllers  by  extending  the  results  in  [65].  For  the  leaderless  consensus  problem 
of  multiple  nonlinear  systems,  papers  [35]  and  [67]  proposed  distributed  controllers  with  the 
aid  of  the  set-valued  Lyapunov  theory  for  multiple  discrete-time  systems  and  continuous 
time  systems.  In  [40],  the  lcaderless  consensus  problem  of  multiple  nonlinear  systems  in 
feed-forward  form  was  considered.  Distributed  controllers  were  proposed  with  the  aid  of 
backstepping  techniques. 

The  leader-following  consensus  problem  has  been  extensively  studied  in  recent  years.  For 
multiple  first-order  linear  systems  with  a  leader,  consensus  algorithms  were  proposed  with 
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the  aid  of  distributed  estimators  in  [41]  and  [42],  For  multiple  second-order  linear  systems 
with  a  leader,  consensus  algorithms  were  proposed  in  [43,44,68,69]  and  [70]  such  that  the 
tracking  errors  between  systems  converge  to  zero  within  finite  time.  For  multiple  high- 
order  linear  systems,  the  leader-following  consensus  problem  was  studied  in  [71-73]  and  [74], 
The  leader- following  consensus  problem  can  be  considered  as  a  distributed  output  regulation 
problem  where  a  leader  is  considered  as  an  exosystem.  In  [75],  it  was  shown  that  the  internal 
model  principle  is  necessary  and  sufficient  for  the  distributed  output  regulation  problem  of 
multiple  linear  systems.  With  the  aid  of  internal  model  principle  several  dynamic  control 
laws  have  been  proposed  in  [76,77]  and  [78]. 

Flocking  and  synchronization  of  multiple  systems  are  closely  related  to  the  consensus 
problem.  In  [45],  flocking  of  multiple  second-order  systems  was  solved  with  the  aid  of  po¬ 
tential  functions  under  the  assumption  that  a  desired  trajectory  is  available  to  each  system. 
In  [47,48,79]  and  [80],  flocking  algorithms  of  multiple  second-order  linear  systems  were  pro¬ 
posed  under  the  assumption  that  the  information  of  a  virtual  leader  is  available  to  a  portion 
of  systems.  In  [81],  distributed  algorithms  were  proposed  for  flocking  of  multiple  robots  with 
the  aid  of  backstepping.  In  [49]  and  [50] ,  synchronization  of  unknown  nonlinear  networked 
systems  was  considered.  Distributed  adaptive  control  laws  were  proposed  with  the  aid  of 
neural  network  approximation  such  that  the  tracking  error  is  uniformly  ultimately  bounded 
(UUB).  In  [82],  the  synchronization  problem  of  general  dynamical  networks  was  considered 
for  directed  and  weakly  connected  network  topology.  Exponential  control  laws  were  proposed 
by  using  the  Lyapunov  functional  method  and  the  Kronecker  product  technique.  Some  other 
papers  which  are  closed  to  this  paper  are  [83-85]. 

Though  extensive  research  has  been  carried  out  for  the  leader-following  consensus  prob¬ 
lem  of  multiple  linear  and  nonlinear  systems,  there  is  few  research  on  the  leader-following 
control  problem  of  multiple  nonholonomic  systems.  However,  in  practice  many  systems  are 
nonholonomic  systems  and  have  underactuated  nature.  For  example,  wheeled  mobile  robots 
(WMRs)  in  [4],  unmanned  aerial  vehicles  (UAVs)  in  [86],  etc.  It  is  necessary  and  im¬ 
portant  to  study  the  leader- following  control  problem  of  nonholonomic  systems.  In  [87],  the 
leader-following  consensus  problem  of  multiple  chained  system  has  been  studied.  Distributed 
controllers  are  proposed  with  the  aid  of  the  results  on  cascade  systems.  In  this  paper,  we  still 
consider  this  problem.  A  new  approach  is  proposed  with  the  aid  of  backstepping  techniques. 
If  the  state  of  each  system  is  measurable,  distributed  adaptive  state  feedback  controllers  are 
proposed  with  the  aid  of  backstepping  techniques  and  results  from  graph  theory  by  using 
neighbors’  local  information.  If  the  state  of  each  system  is  not  measurable,  distributed  adap¬ 
tive  output  feedback  controllers  are  proposed  with  the  aid  of  observer  design  for  each  system. 
Simulation  validates  the  proposed  results.  Compared  to  the  results  in  [87],  the  contributions 
of  our  results  are  as  follows: 

•  A  new  approach  is  proposed  for  distributed  tracking  control  of  nonlinear  systems  with 
the  aid  of  backstepping  techniques  and  the  properties  of  Laplacian  matrix  of  directed 
graphs. 

•  The  proposed  distributed  adaptive  controllers  can  estimate  the  unknown  information 
on-line  by  local  information.  In  [87]  some  information  of  the  leader  system  should 
be  known  in  advance  for  each  follower  system.  Therefore,  the  controllers  proposed  in 
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this  paper  are  intrinsically  decentralized  and  are  independent  of  the  information  of  the 
leader  system. 

The  remaining  parts  of  this  chapter  are  organized  as  follows.  In  Section  5.2,  the  problem 
considered  in  this  paper  is  defined.  In  Section  5.3,  distributed  state  feedback  controllers  are 
proposed.  In  Section  5.4,  distributed  output  feedback  controllers  are  proposed.  In  Section 
5.5,  an  application  of  the  proposed  results  is  presented.  The  last  section  concludes  this 
paper. 


5.2  Problem  Statement 

Consider  a  group  of  m  nonholonomic  systems  in  the  chained  form.  The  motion  of  system  j 
is  described  by 


Xij  V  ]  j ,  X2j  ^2  j:  ■X'ij  ]  j ,  3  ^  7  ^  71,  ]Jj  ( 5 . 1 ) 

where  x*j  =  [xij ,  x2j ,  ■  ■  ■ ,  xnj]T  is  the  state,  v\j  and  V2 j  are  control  inputs,  and  yj  is  the 
output.  For  each  system  the  available  information  for  feedback  is  its  own  information  and 
its  neighbors’  information  measured  by  sensors  or  received  from  wireless  networks.  If  each 
system  is  considered  as  a  node,  the  communication  between  systems  can  be  described  by  a 
directed  graph  (digraph  for  short)  Q  =  {V,  £},  where  V  =  {1,2, .. . ,  m}  is  a  node  set,  and 
£  is  an  edge  set  with  ordered  pair  (i,j)  which  describes  the  communication  from  node  i  to 
node  j.  If  the  information  of  node  %  is  available  to  node  j,  node  i  is  called  a  neighbor  of  node 
j.  The  set  of  all  neighbors  of  node  j  is  denoted  by  Afj.  Node  i  is  said  to  be  reachable  for 
node  j  if  there  exists  a  set  of  edges  which  connect  node  i  to  node  j  with  respecting  to  their 
directions.  Node  i  is  said  to  be  globally  reachable  if  it  is  reachable  from  every  other  node  in 
the  graph  Q. 

Remark  5.1.  The  model  in  (5.1)  is  one  type  of  canonical  forms  of  nonholonomic  systems. 
Wheeled  mobile  robots  with  two  control  inputs  can  be  described  by  (5.1)  after  state  and  input 
transformation  in  [3]  and  [f].  Some  unmanned  aerial  vehicles  can  also  be  described  by  (5.1) 
(see  [86]).  In  (5.1),  the  output  y3  only  has  two  states.  The  availability  of  these  two  states 
are  the  least  requirement  for  theoutput  feedback  control  problem  considered  in  this  article. 

It  is  given  a  leader  (labeled  as  system  0)  defined  by 
^10  —  ^10 >  ^20  —  ^20)  %i0  —  vWxi-\,Qi  3  <  i  <  71,  y^  =  [X\q,  X20,.  ■  ■  ,  Xnf^  (5-2) 

where  vw  and  u2o  are  known  time-varying  functions,  x^q  =  [xw,x2q,  ■  ■  ■  ,a;,lo]T  is  the  state, 
and  7/o  is  the  output.  We  assume  that  the  state  of  the  leader  is  available  to  a  portion  of  the 
m  systems  in  (5.1).  Consider  system  0  in  (5.2)  and  the  m  systems  in  (5.1)  as  a  group  of 
systems.  The  communication  graph  of  the  m  +  1  systems  is  denoted  by  Qe.  The  neighbor 
set  of  node  j  is  denoted  by  N J  for  1  <  j  <  m.  Since  system  0  is  the  leader,  A/"0e  =  0. 

The  following  two  distributed  control  problems  are  considered  in  this  paper. 
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Distributed  State  Feedback  Control  Problem:  Design  distributed  control  laws  V\j 
and  v2j  for  system  j  using  its  own  state  x*j  and  its  neighbors’  states  xm  for  i  G  A ff  such  that 

lim  -  x*0)  =  0  (5.3) 


for  1  <  j  <  m. 

Distributed  Output  Feedback  Control  Problem:  Design  distributed  control  laws 
V\j  and  v2j  for  system  j  using  its  own  output  y.j  and  its  neighbors’  outputs  yi  for  i  G  J\ff 
such  that  (5.3)  holds  for  1  <  j  <  m. 

In  order  to  solve  the  defined  control  problems,  the  following  assumptions  are  made  on 
the  leader. 

Assumption  5.1.  Variable  V\G  is  differentiable  up  to  (n  —  2)-th  order.  The  (0  <  i  <  2) 
are  bounded  and 

rt+Ti  rt-\-T2 

/  vio ~4(T)dT  >  o'!,  /  vl0(r)dr  >  a2,  Vt  >  0 

Jt.  Jt 

where  aii  and  (1  <  i  <  2)  are  positive  constants. 

Assumption  5.2.  The  vector  x30  =  [£30,  £40,  •  •  •  ,^no]T  is  bounded. 

Assumption  5.1  means  that  the  signal  Ui0~2  and  U10  are  persistently  excited  signals  (PE 
signals)  (see  [5]  for  the  definition  of  a  PE  signal).  This  assumption  is  due  to  the  fact  that 
the  considered  systems  are  nonholonomic. 

For  a  PE  signal,  the  following  lemma  is  useful. 

Lemma  5.1.  (Lemma  4-8.3  in  [5])  Signals  £1  (t)  G  R  and  £2(£)  £  R  are  bounded.  If  £1  is  a 
PE  signal  and  (£4  —  £2)  converges  to  zero,  then  £2  is  a  PE  signal. 

Lemma  5.2.  For  the  system 

C  =  ~Vi(t)t  +  m(t)  (5-4) 

where  r}i(t)  G  R  is  a  bounded  PE  signal,  if  772(f)  is  bounded  and  rj2(t)  converges  to  zero,  then 
(  converges  to  zero. 

Proof:  The  solution  of  (5.4)  is 

C(t)  =  efo-^dTao)+  [' e^-v^)duV2(T)dr<e-St+bl  C(0)  +  e~Ht-T)+b2V2(T)dT 

Jo  Jo 

=  eble-st((0)  +  eb2  C  e-^^Mdr 

Jo 

where  5  >  0,  b\  >  0,  and  b2  >  0.  Since  y2(t)  is  bounded  and  converges  to  zero,  e_<5't_T)r/2(r)dr 
converges  to  zero  with  the  aid  of  the  theorem  in  Section  4.1  in  [88].  Therefore,  (  converges 
to  zero.  ■ 
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For  a  digraph  Q  with  weight  matrix  A  =  [a,ji]mxm  (a3i  >  0),  its  weighted  Laplacian 
matrix  £  =  [Ljf\  is  defined  by 

{—  a3i,  if  i  ^  j  and  i  G  Afj 

SA  i!t=j  (5-5) 

0,  otherwise 

On  the  weighted  Laplacian  matrix,  the  following  results  are  useful. 

Lemma  5.3.  For  the  digraph  Q  with  weight  matrix  A  =  [ aji ]  (aji  >  0)  and  a  nonzero 
nonnegative  vector  f  G  ,  if  the  information  of  f  is  globally  reachable  to  the  nodes  in  the 
digraph  Q,  then  we  have  the  following  results: 

1.  the  real  part  of  the  eigenvalues  of  the  matrix  (£  +  diag(£))  are  all  positive; 

2.  there  exists  a  diagonal  positive  definite  matrix  P  such  that  Q  =  P(£  +  diag(£))  +  (£  + 
diag(£))TP  is  a  symmetric  positive  definite  matrix; 

3.  for  the  system 

X  =  ~£x  ~  diag(£)(x  -  dl)  -  M  sign  (£*  +  diag(£)(x  -  dl))  (5.6) 

where  1  =  [1, 1, ... ,  1]T,  if  d(t)  G  R  is  a  differentiable  signal  and  maxte[oi00)  \d(t)\  < 
M  <  oo,  then  (x  ~  dl)  exponentially  converges  to  zero. 

Proof:  1.  Item  1  has  been  proved  in  Lemma  1.6  in  [89]. 

2.  For  item  2,  with  the  aid  of  the  result  in  Item  1  and  Theorem  4.25  in  [38]  (£  +  diag(£))  is 
a  non-singular  M- matrix  and  there  exists  a  diagonal  positive  matrix  P  =  diag(Pi,  P2, ,  Pm) 
such  that  (P(£  +  diag(£))  +  (£  +  diag(£))TP)  is  positive  definite. 

3.  It  is  shown  in  Lemma  2.7  in  [87].  ■ 

If  the  digraph  Q  is  bidirectional,  the  following  results  can  be  obtained. 

Lemma  5.4.  For  the  digraph  Q  with  weight  matrix  A  =  [a.3f\  (a3i  =  ai3  >  0),  if  the  graph  Q 
is  bidirectional  and  connected  and  f  G  is  a  nonzero  nonnegative  vector,  then  we  have  the 
following  results: 

1.  the  matrix  (£  +  diag(£))  is  a  symmetric  positive  definite  matrix; 

2.  for  the  system 

X  =  -£x,  ~  diag(0(x  -  dl)  -  diag(Mi, . . . ,  Mm)  sign  (£y  +  diag(£)(x  -  d%$)7) 
=  7 j  Y.  aAxj  -  Xi)-Zj(Xf-d)  ,  1  <j<m  (5.8) 

ieAtj 

where  7 j  >  0  (1  <  j  <  m)  and  \  =  [xi ,  X2,  ■  ■  ■ ,  Xm)T ,  if  d(t)  G  R  is  a  differentiable 
signal  and  maxtg[0iOo)  \d(t)\  <  M  <  00,  then  (x  —  dl)  asymptotically  converges  to  zero 
and  Mj  is  bounded. 
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Proof:  1.  Item  1  has  been  proved  in  [38]. 

2.  Let  x  —  X  ~  dl  and  q  =  [g1?  q2, . . . ,  g,n]T  —  {C  +  diag(£))%,  we  choose  a  Lyapunov 
function  candidate 

m 

V  =  xT{C  +  diag(0)x  +  Et -  Mj)2  (5.9) 

3= 1 

and  differentiate  it  along  the  solutions  of  (5.7)-(5.8),  one  has 

V  =  -2xT(£  +  diag(0)2X  -  2xT(C  +  diag(£))diag(Mi, . . . ,  Mm)sign(g) 

m 

-2yT(/:  +  diag(0)ld  -  2  E  lj\M  -  Mj)Mj 

3= 1 

m 

=  -2xT(£  +  diag(0)2X  -  2MgTsign(g)  -  2qTld  -  2  E  -  Mj)Mj 

3= i 

+2gTdiag(M  —  M1; . . . ,  M  —  Mm)sign(g) 

mm  m 

<  -2xT(£  +  diag(0)2X  -  2ME  kbl  +  2E^y  “SEf/1^  ~ 

j=i  j=i  j=i 

m 

+2J2(M-  M,)l?jl 

J=1 

<  -2xT(^  +  diag(O)2X<0  (5.10) 

which  means  that  1/  is  bounded.  So,  x  and  Mj  are  bounded.  By  integrating  both  sides  of 
(5.10),  it  can  be  shown  that  x  is  squarc-integrable.  With  the  aid  of  Barbalat’s  lemma,  x 
converges  to  zero.  So,  (x  —  dl)  converges  to  zero.  ■ 

5.3  Distributed  State  Feedback  Controller  Design 

5.3.1  Variable  transformation 

In  order  to  design  distributed  controllers,  we  first  introduce  a  variable  transform  such  that 
system  (5.1)  is  transformed  to  a  special  form.  For  system  j,  we  define  the  variables 

Zij  =  Xij  —  atj,  1  <  i  <  n  (5-11) 

with  the  aid  of  the  backstepping  techniques,  where 

ai  j  = 

&n—2,j 


,2n— 5 , 


0,  &nj  ^5  ^n—l,j  ^"nV\j  . 

,2n— 5  _  ^  /r*  r\7„  2n— 7 


Zn—lJ  Znj  (272  5  ^)knV\j  knV^j  Znj 


(5.12) 

(5.13) 


_7  zn—b 

i  —  3, . . . ,  n  —  2 


dan~i+i  zn  .. 


i— 2  i  Q  i— 2 

^n-?+2,j  +  2^  ...  0  [/]  V1  j  +  Z^ 

Z=0  Z=0  OZn-lj 


Vlj 


#14) 
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ki  >  0  and  vfj  denotes  the  Z-th  order  derivative  of  v\j  with  respect  to  time,  then 


Zlj 

=  Vi  j 

(5.15) 

z2j 

doi2j 

=  ^  dt 

(5.16) 

z3j 

=  -k3vlj  Az3j  +  Vlj(z2j  -  Zij) 

(5.17) 

:n-l,j 

Zn—i  j  “h  Vlj(Zn—2,j  ^nj ) 

(5.18) 

Znj 

k"nV i j  Znj  -j-  V\j Zn—ij 

(5.19) 

for  j  =  0, 1,  2, ,  m. 

Remark  5.2.  Noting  the  special  structure  of  atij,  it  can  be  proved  that  a ^  does  not  contain 
the  term  after  expanding  each  term  in  the  transformation.  Therefore,  a.ij  is  well  defined 
even  if  vy  is  zero  at  some  time. 

For  the  new  variables,  the  following  lemma  can  be  proved  and  its  proof  is  omitted. 
Lemma  5.5.  For  the  {m  F  1)  systems  in  (5.15)-(5.19),  if 

hrn  ( Zij  —  Zi o)  =  0  and  hm  (nfj  —  n[o)=0  (5.20) 

for  1  <  i  <  n,  0  <  l  <  n  —  3,  and  1  <  j  <  m,  then  (5.3)  hold. 

With  the  aid  of  Lemma  5.5,  design  of  controllers  for  the  distributed  state  feedback  control 

problem  is  equivalent  to  design  of  distributed  controllers  V\j  and  Vi  j  for  the  m  systems  in 
(5.15)-(5.19)  (1  <  j  <  m )  such  that  (5.20)  is  satisfied. 

Noting  the  special  structure  of  the  systems  in  (5.15)-(5.19),  the  conditions  in  (5.20)  can 
be  refined  in  the  following  lemma. 

Lemma  5.6.  For  the  (m  F  1)  systems  in  (5.15)-(5.19),  wider  Assumptions  5. 1-5.2,  if 


(ffj  -  tifj) 

=  0 

(5.21) 

lto  (^,  - 

=  0 

(5.22) 

for  1  <  j  <  m  and  0  <  l  <  n  —  3,  then 

lim  (zij  -  Zi 0) 

t-»oo  J 

=  0 

(5.23) 

for  3  <  i  <  n  and  1  <  j  <  m. 

Proof:  Let  %  =  —  Zio  for  2  <  i  <  n,  then 

Z3j  =  -k3vlj~4z3j  +  vlj(z2j-Z4j)+k3(vlQ~4-vjj~4)z30 

F(vij  —  V\o)(z2o  —  Z40)  (5-24) 

Zn—l.j  ^n—l^n—l,jZn—l,j  F  ^ Ij {Zn—2,j  Zn o)  “I-  kn—  l(ufg  V\j  )^n— 1,0 

F{V\j  —  Ulo)(^n-2,0  —  Zn  o) 

Znj  knV \ j  Znj  F  V ij Zn—  i  j  F  kn(v^Q  V\j  ) ZnO  F  (pij  Vlf) Zn— 1,0 
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(5.25) 

(5.26) 


Let  a  nonnegative  function 


1  n 

v  =  \Y.% 

z  i=3 

and  differentiate  it  along  the  solution  of  the  systems  in  (5.24)-(5.26),  we  have 

n  n  n—  1 

v  =  -  kiz?jvij~4  +  X!  kiZijZi0(v^4  -  vlj~4)  +  J2  Zlj(zi- 1,0  -  2j+i,o)(uij  -  Uio) 

1=3  1=3  1=3 

+ZnjZn-i:o(vij  —  Vio)  +  Z3jZ2jl’ij. 

Noting  the  facts:  (1).  Z30  =  [^30,  ^40,  •  •  •  ,  £no]T  is  bounded  due  to  Assumption  5.2;  (2).  v\j 
and  Vio  are  bounded;  and  (3).  eqns.  (5.21)-(5.22)  hold,  we  have 

v  <  +  £  |%|/i(«)  =  -2kv^-‘v  +  £  \hi\Mt)  <  -2 kvl]~‘v  +  Vwfjt) 

1= 3  1=3  1= 3 

where  k  =  min3<Kn{fc;}  and  f\  (t)  is  nonnegative  and  converges  to  zero.  Let  V\  =  y/V,  it 
can  be  proved  that 

V,  <  -kv%-*V i  + 

Since  (vy  —  iqo)  satisfies  (5.21)  and  Ui0  satisfies  Assumption  5.1,  vff  4  is  a  PE  signal  by 
Lemma  5.1.  With  the  aid  of  the  comparison  lemma  in  [90]  and  Lemma  5.2,  V\  converges  to 
zero.  Therefore,  V  converges  to  zero.  So,  (5.23)  holds.  ■ 

Lemma  5.6  means  that  the  convergence  of  Z2j  to  Z20  and  v\3  to  ujo  guarantees  the  conver¬ 
gence  of  Zij  to  zi0  for  3  <  j  <  m.  Therefore,  with  the  aid  of  Lemmas  5. 5-5. 6  the  distributed 
state  feedback  control  problem  is  solved  if  distributed  control  laws  v\j  and  v2j  can  be  designed 
such  that  (5.21)-(5.22)  hold  and 

lim  (zij  —  zio)  =  0  (5.27) 

t=f  00 

for  1  <  j  <  m. 

5.3.2  State  Feedback  Controller  Design 

We  design  control  law  V\j  Erst.  Noting  that  vfj  for  0  <  l  <  n  —  3  are  required  in  atJ ,  v\j 
should  be  differentiable  up  to  (n  —  2)-th  order.  To  this  end,  we  propose  dynamic  controllers 
as  follows. 

Lemma  5.7.  For  the  (m  + 1)  systems  in  (5.15),  if  the  state  of  system  0  is  globally  reachable 
to  other  systems,  then  the  distributed  control  laws 


VU  = 

~  Pi zlj  +  £l  j 

(5.28) 

£l  = 

~^2^1j  ~  Zlj  +  £2? 

(5.29) 

n-3  ,j  = 

fn—2(n—3,j  £ra— 4j  T  (n—2.j 

(5.30) 

,n-2,j  = 

-si j  ~  Pi  sign  (.S'u) 

(5.31) 
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for  1  <  j  <  m  ensure  that  (5.21)  and  (5.27)  hold,  where  (1  <  i  <  n  —  2)  are  positive 
constants. 


sij 


Pj 


'y  '  dji(,in—2,j  fn—2,o) 

ieJVj 

J  1,  if  the  state  of  system  0  is  available  to  system  j; 
1  0,  otherwise 


(5.32) 

(5.33) 


aji  >  0,  bj  >  0.  and  p\  is  a  sufficiently  large  number. 

Proof:  Let  (n-2,*  =  [in- 2,1,  in-2,2,  •  •  • ,  in-2, m]T ,  one  has 

in— 2,*  h-'in— 2,*  Bifn— 2,*  in— 2,0^)  Pi  sign  2,*  T  B{fn—2,*  in— 2,q1))  (5.34) 


where  B  =  diag(6i/ii,  b2p2,  •  •  • ,  bmpm).  If  p\  is  chosen  such  that 

Pi>  max  | £n-2,o CO  |, 

te[0,oo) 


(5.35) 


by  Lemma  5.3  in-2, j  exponentially  converges  to  in-2,0  for  1  <  j  <  m. 

Next,  we  show  that  (5.21)  and  (5.27)  hold  for  1  <  j  <  m.  Dehne  Z\j  =  Zij  —  zi0  and 
iij  =  iij  —  iio  for  1  <  i  <  n  —  3,  one  has 


Zij  —  —/3\Zij+iij 

iij  =  —faiij  —  +  i2j 


(5.36) 

(5.37) 


Let 


I 


n-3,j 


fin—2in—3,j  (n—4,j  T  in— 2. 


(5.38) 


1  n”3  ~  1 
9  ^ij  '  9  lj 
z  i=\  z 


(5.39) 


differentiate  V2  along  the  solution  of  (5.36)-(5.38),  one  has 


n— 3 


(5.40) 


i= 1 


where  /3  =  min1<j<n_2{A}-  Let  V3  =  yfV),  then 


<  -§v3  + 

With  the  aid  of  the  comparison  lemma  [90]  and  Lemma  5.2,  V3  exponentially  converges 
to  zero.  Therefore,  V2  exponentially  converges  to  zero.  Hence,  (5.21)  and  (5.27)  hold  for 
1  <  j  <  m.  ■ 

For  the  control  input  v2j,  the  following  distributed  control  laws  are  proposed. 
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Lemma  5.8.  For  (m  +  1)  systems  in  (5.16),  if  the  state  of  system  0  is  globally  reachable 
to  other  systems,  then  the  distributed  control  laws 

v2j  =  -s2j  -  p2  sign  (s2j)  +  a2j 

for  1  <  j  <  m  ensure  that  (5.22)  holds,  where 

$2j  =  X]  aji(Z2j  ~  Z2i)  +  bjPj(z2j  —  Z2f) 

Nj 

and  p2  is  a  sufficiently  large  number. 

Proof:  Let  2i2*  =  [7u,  z22,...,  z2m]r ,  one  has 

Z2*  =  —C-Z2*  -  B(z2*  -  z20l)  -  p2sign  (> Cz2, *  -  B(z2 *  +  i20 1))  (5.43) 

If  p2  is  chosen  such  that 

p2  >  max  |i2o(0l>  (5.44) 

ie[0,oo) 

by  Lemma  5.3  z2j  exponentially  converges  to  z2 0  for  1  <  j  <  m.  ■ 

With  the  aid  of  Lemmas  5. 5-5. 8,  we  have  the  following  results. 

Theorem  5.1.  For  m  systems  in  (5.1)  and  a  leader  in  (5.2)  with  Assumptions  5. 1-5.2,  if 
the  state  of  the  leader  is  globally  reachable  to  other  systems,  then  the  distributed  state  feedback 
control  laws  v\j  in  (5.28)-(5.31)  and  v2j  in  ( 5.fl )  ensure  that  (5.3)  holds. 

Proof:  By  Lemma  5.7,  the  control  laws  V\3  in  (5.28)-(5.31)  for  1  <  j  <  m  ensure  that 
(5.21)  and  (5.27)  hold.  By  Lemma  5.8,  the  control  laws  v2]  in  (5.41)  ensure  that  (5.22)  holds. 
By  Lemmas  5. 5-5. 6,  (5.3)  holds.  ■ 

In  Theorem  5.1,  p\  and  p2  should  be  chosen  such  that  (5.35)  and  (5.44)  are  satisfied. 
Since  £n_2,o  and  i20  are  not  available  to  each  system,  the  lower  bounds  in  (5.35)  and  (5.44) 
are  not  available  to  each  system.  Therefore,  p\  and  p2  should  be  chosen  large  enough.  It  is 
possible  to  estimate  p\  and  p2  online  by  each  system  with  the  aid  of  neighbors’  states  as  in 
the  following  theorem. 

Theorem  5.2.  For  m  systems  in  (5.1)  and  a  leader  in  (5.2)  with  Assumptions  5. 1-5.2,  if  the 
communication  graph  Q  is  bidirectional  and  connected  and  the  state  of  the  leader  is  available 
to  at  least  one  of  the  m  systems,  then  the  distributed  state  feedback  control  laws 


v\] 

—  ~  +  fij. 

(5.45) 

v2j 

=  ~s2j  ~  p2j  sign  (s2j)  +  a2j 

(5.46) 

62 

=  -fofij  ~  Zlj  +  %2j 

(5T7) 

■n-3,j 

fn—2f,n—3,j  £n—4 ,j  T  £n—2,j 

(5.48) 

•n—2,j 

=  -sij  -  pij  sign  (sij) 

(5.49) 

Plj 

=  7ij  sij 

(5.50) 

f>2j 

=  l2j\s2j\ 

(5.51) 

(5.41) 

(5.42) 
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ensure  that  (5.3)  holds  and  p\3  and  p2j  are  bounded,  where  ff  >  0,  71  j  >  0,  7 2j  >  0,  s i3  and 
s2j  are  defined  in  (5.32)  and  (5.f2),  respectively,  and  aji  =  atj  >  0. 

Proof:  Let  £n_2)*  =  [&1-27,  in-2,2,  ■  ■  • ,  in-2,', mV ,  one  has 

fn—2,*  f-'in— 2,*  B  (in— 2,*  in— 2,(4) 

-diag(pn, . . . ,  Pim)sign  (. ££n_2 ,*  +  #(&»- 2,*  -  fn_2i0l))  (5.52) 

For  the  systems  in  (5.52)  and  (5.50),  by  Lemma  5.4  fn-2,j  converges  to  in-2,0  and  p\3  is 
bounded  for  1  <  j  <  m. 

By  following  the  proof  of  Lemma  5.7,  it  can  be  shown  that  (5.21)  and  (5.27)  hold  for 
1  <  j  <  m.  Similarly,  we  can  show  that  (5.22)  holds.  By  Lemmas  5. 5-5. 6,  (5.3)  holds.  ■ 
In  Theorem  5.1,  the  communication  graph  is  assumed  to  be  fixed.  If  the  communication 
topology  is  switching,  we  have  the  following  results. 

Theorem  5.3.  For  m  systems  in  (5.1)  and  a  leader  in  (5.2)  with  Assumptions  5. 1-5. 2,  if  the 
communication  graph  Q  is  bidirectional  and  connected  and  the  state  of  the  leader  is  available 
to  at  least  one  of  the  m  systems  at  each  instant,  then  the  distributed  state  feedback  control 
laws  v\j  in  (5.28)-(5.31)  and  v2j  in  (5.fl)  ensure  that  (5.3)  holds. 

Theorem  5.3  can  be  proved  by  following  the  proofs  of  Lemmas  5. 7-5. 8  and  Theorem  5.1. 
However,  since  the  communication  topology  is  switching  the  proof  should  be  revised  with 
the  aid  of  the  fact  that  £  is  symmetric.  For  brevity  of  the  paper,  the  proof  is  omitted. 

In  the  above  theorems,  in  the  control  laws  for  system  j  the  required  information  are 
the  state  of  system  j  and  the  state  of  system  i  for  i  £  J\fr  The  state  of  the  leader  is  not 
required  to  be  known  to  each  system.  In  contrast  to  the  leader-following  approach  in  [23], 
the  leader- following  communication  pattern  has  been  pre-dehned  before  the  controller  design. 
In  Theorem  5.1,  there  is  no  pre-dehned  patterns  for  the  communication  between  systems. 
Instead,  the  requirement  is  that  the  m  systems  are  strongly  connected  and  the  state  of 
the  leader  is  available  to  at  least  one  of  the  m  systems.  Moreover,  the  requirement  on  the 
communication  digraph  can  be  relaxed  to  the  the  state  of  the  leader  system  is  accessible  to 
each  system. 

In  [87],  the  tracking  control  of  multiple  chained  systems  with  a  leader  was  considered. 
Distributed  tracking  controllers  were  proposed  with  the  aid  of  the  results  of  linear-time 
varying  systems.  In  this  paper,  we  consider  the  same  control  problem  and  propose  new 
distributed  tracking  controllers  with  the  aid  of  a  new  special  structure  of  the  transformed 
systems  and  adaptive  control  theory.  In  this  paper,  the  proposed  distributed  tracking  con¬ 
trollers  are  adaptive  ones  and  can  estimate  the  bound  of  unknown  information  of  the  leader 
system  online  by  local  information.  While  in  [87]  the  bound  of  of  some  information  of  the 
leader  system  should  be  known  in  advance. 

5.4  Distributed  Output  Feedback  Controller  Design 

If  states  Xij  for  2  <  %  <  n  —  1  are  not  measurable,  we  design  an  estimator  for  system  j.  The 
following  observer  can  be  proposed  with  the  aid  of  the  results  in  [18]. 
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Lemma  5.9.  For  system  j,  the  observer  is  proposed  as 


X2J 

.  t  modi m— 2,2)  /  ^  \ 

=  V2j  +  Im-lVy  [x2n  —  X2n) 

(5.53) 

%3j 

=  VljX2j  +  lm-2Vij  ( x2n  ~  X2n) 

(5.54) 

n-1  ,j 

=  V\jXn-2j  +  l2V\j(x2n  F  X2n) 

(5.55) 

Xnj 

v\jXn—  i  j  F  li(x2n  x2n) 

(5.56) 

where  k  (1  <  i  <  m  —  1)  are  chosen  such  that  the  polynomial 

yrn  1  _|_  2  +  •  •  •  -f-  lm_2\  +  lm-\ 

is  Hurwitz  (i.e.  have  their  roots  in  the  left  half  of  the  open  complex  plane)  and  mod(k,2 ) 
denotes  the  fractional  part  of  If  v\j  is  a  PE  signal,  then  ( —  Xij )  for  2  <  i  <  n 
exponentially  converge  to  zero. 

With  the  aid  of  the  observer  in  (5.53)-(5.56),  we  design  distributed  controllers  by  following 
the  controller  design  procedure  in  the  last  section.  For  simplicity  of  notation,  we  let  xi0  =  xi0 
for  2  <  i  <  n.  Define  the  variables 


Z\j  X |  j  O  |  j ,  Z2j  X2 j  O 2j ,  •  •  •  ,  Znj  Xnj  O' nj  (5.57) 

where  aVJ  (1  <  i  <  n,  0  <  j  <  m)  are  defined  in  (5.12)-(5.14),  we  have  the  following 
equations 


Z\j 

=  Vi  j 

(5.58) 

z2j 

dot2j  7  modi m— 2,2)  /  ^  \ 

=  V2j  +lm-  lVij  (■ Xnj  Xnj ) 

(5.59) 

Z'ij 

=  +  Vlj{z2j  ~  Z4j)  +  lm-2V™dim~3,2)  (%nj  ~  %nj) 

(5.60) 

n—l,j 

Zn—\  j  ~\~  V\j(KZn—2,j  Znj )  +  l2V\ j(,%nj  %nj ) 

(5.61) 

Znj 

k"nV\j  Znj  ~\~  V\j Zn — \,j  “1“  ’Znj ) 

(5.62) 

for  j  =  0, 1,  2, ... ,  m. 

For  the  new  variables  in  (5.57),  it  can  be  proved  that  Lemmas  5. 5-5. 6  hold.  Since  x\3  is 
available  for  controller  design,  the  controllers  V\3  (1  <  j  <  m)  can  be  designed  as  these  in 
Lemma  5.7.  Next,  we  propose  distributed  controllers  v2]  (1  <  j  <  m). 

Lemma  5.10.  For  (m  +  1)  systems  in  (5.59)-(5.62),  if  the  state  of  system  0  is  globally 
reachable  to  other  systems,  then  the  distributed  output  feedback  control  laws  v2j  defined  in 
(5.fl)  ensure  that  (5.22)  holds,  where  in  (5.fl)  p2  is  a  sufficiently  large  number  and  s2j  is 
defined  in  (5.f2)  with  Z2j  defined  in  (5.57). 
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Proof:  With  the  control  laws  V\j  in  Lemma  5.5,  V\j  exponentially  converges  to  V\q.  By 
Lemma  5.1  and  Assumption  5.1,  v\j  is  a  PE  signal.  By  Lemma  5.9,  (xnj  —  xnj)  exponentially 
converges  to  zero.  By  the  control  law  v2j ,  one  has 

Z2j  =  - s2j  -  P2  sign (s2j)  +  lm- iv™dim~2’2)  (xnj  -  xnj )  (5.63) 


If  (xnj  —  xnj)  =  0  and  p2  is  chosen  such  that 

p2>  max  |i20(OI 

tG[0,oo) 

by  Lemma  5.3  z2j  exponentially  converges  to  z2 o.  With  the  aid  of  the  inverse  Lyapunov 
theorem,  it  can  be  proved  that  z2j  exponentially  converges  to  zero.  ■ 

With  the  aid  of  Lemmas  5.7  and  5.10,  we  have  the  following  results. 

Theorem  5.4.  For  m  systems  in  (5.1)  and  a  leader  in  (5.2)  with  Assumptions  5. 1-5.2, 
if  the  state  of  the  leader  is  globally  reachable  to  other  systems,  then  the  distributed  output 
feedback  control  laws  Vij  in  (5.28)-(5.31)  and  v2j  in  (5.fl)  ensure  that  (5.3)  holds,  where  p\ 
and  p2  are  sufficiently  large  numbers  and  s2j  is  defined  in  (5.f2)  with  z2j  defined  in  (5.57). 

Proof:  By  Lemma  5.7,  the  control  laws  V\3  in  (5.28)  for  1  <  j  <  m  ensure  that  (5.21) 
and  (5.27)  hold.  By  Lemma  5.8,  the  control  laws  v2]  in  (5.41)  ensure  that  (5.22)  holds.  By 
Lemmas  5.5  and  5.6,  (5.3)  holds.  ■ 

In  Theorem  5.4,  p\  and  p2  can  be  estimated  on-line  by  each  system  with  the  aid  of 
neighbors’  outputs  as  in  the  following  theorem. 

Theorem  5.5.  For  m  systems  in  (5.1)  and  a  leader  in  (5.2)  with  Assumptions  5. 1-5. 2,  if  the 
communication  graph  Q  is  bidirectional  and  connected  and  the  state  of  the  leader  is  available 
to  at  least  one  of  the  m  systems,  then  the  distributed  output  feedback  control  laws  v\3  in 
(5.45)  and  v2j  in  (5-46)-(5.49)  with  the  observer  in  (5.53)-(5.56)  and  the  updated  laws  pij 
and  p2j  in  (5.50)-(5.51)  ensure  that  (5.3)  holds  and  p\j  and  p2j  are  bounded,  where  >  0, 
71  j  >  0,  72j  >  0,  Sij  and  s2j  are  defined  in  (5.32)  and  (5-42)  where  z2j  defined  in  (5.57), 
respectively,  and  aji  =  atJ  >  0. 

If  the  communication  topology  is  switching,  we  have  the  following  results. 

Theorem  5.6.  For  m  systems  in  (5.1)  and  a  leader  in  (5.2)  with  Assumptions  5. 1-5.2,  if  the 
communication  graph  Q  is  bidirectional  and  connected  and  the  state  of  the  leader  is  available 
to  at  least  one  of  the  m  systems  at  each  instant,  then  the  distributed  output  feedback  control 
laws  v\j  in  (5.28)  and  v2]  in  (5-41)  ensure  that  (5.3)  holds,  where  p\  and  p2  are  sufficiently 
large  numbers  and  s2j  is  defined  in  (5-42)  with  z2j  defined  in  (5.57). 

Theorems  5.5  and  5.6  can  be  proved  similarly  as  the  proofs  of  Theorems  5.2  and  5.4.  For 
brevity  of  the  paper,  the  proof  is  omitted. 
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5.5  An  Application 

To  show  the  effectiveness  of  the  proposed  results,  an  application  of  the  proposed  results  to 
formation  control  is  considered.  It  is  assumed  that  there  are  five  identical  nonholonomic 
car-like  robots  moving  on  a  horizontal  plane.  The  structure  and  configuration  of  each  robot 
is  shown  in  Fig.  5.1.  The  kinematics  of  robot  j  is 

ij  =  Vj  cos (9j  +  (pj),yj  =  Vj  sin (9j  +  (pj),  9j  =  Vj  sin  <pj/lj,pj  =  ojj  (5.64) 

where  v3  and  uij  are  the  driving  and  steering  velocity  inputs,  respectively.  The  communication 
between  five  systems  is  defined  by  a  digraph  Q .  It  is  given  a  desired  formation  T  defined 
by  coordinates  (pXj,Pyj)  (1  <  j  <  5)  which  satisfy  YCj=  \  Pxj  =  0  and  Y^j=\Pyj  —  0  and  a 
reference  system  defined  by 


x0  =  v0  cos(6»0  +  p0),Po  =  Vo  sin(6>0  +  <p0),  60  =  v0  sin  <p0/l0,  (p0  = 


(5.65) 


where  v0  and  c^o  are  known  time-varying  functions.  The  state  of  the  reference  system  is 
available  to  a  portion  of  the  five  robots.  We  consider  the  following  formation  control  problem. 

Formation  Control  Problem:  Design  distributed  control  laws  v3  and  uij  for  system  j  using 
its  own  state  information  and  its  neighbor’s  state  information  such  that 


lim  (xj  —  Xi) 

t — ^oo  '  3  11 


Pxj-Pxi,  -  Vi)  =  Pyj  -  Pyi, 


lim 

£—>■00 


0, 


lim 

t—}  OO 


0 


(5.66) 

(5.67) 


In  the  formation  control  problem,  (5.66)  means  that  the  five  robots  come  into  formation 
and  (5.67)  means  that  the  centroid  of  the  five  robots  asymptotically  tracks  the  position  of 
the  reference  system. 

In  order  to  solve  the  formation  problem  with  the  aid  of  the  proposed  results,  we  transform 
the  formation  control  problem  to  the  control  problem  considered  in  this  paper.  To  this  end, 
we  define 

'  X\j  =  (Ij  +  pj 

x2j  =  (xj  -  pxj)  cos (0j  +  <pj)  +  (yj  -  pyj)  sin (6j  +  ip3) 

<  xs j  =  ixj  ~  Pxj)  sin (6j  +  pj)  -  (; y3  -  Pyj)  cos (6j  +  c pj )  (5.68) 

vij  =  sin  (pjVj/lj+Uj 


{  V2j  =  Vj  ~  UJjX3j 


for  0  <  j  <  m.  Then,  we  have 


xi j  =  v1:j,  x2j  =  v2j,  x3j  =  vljx2j,  0  <  j  <  5.  (5.69) 

It  can  be  shown  that  for  the  systems  in  (5.69)  if  (5.3)  holds  the  formation  control  problem 
is  solved. 

In  the  simulation,  it  is  assumed  that  in  the  reference  system  (i.e.,  j  =  0  in  (5.69)) 
Uio  =  0.5,  v2q  =  —  0.25 sin(0.5f),  and  the  initial  condition  x*o  =  [0,0.5,0]T,  which  means 
that  the  state  of  the  reference  system  is  (xio,  x2o,  x3o)  =  (0.5f,  0.5  cos(0.5f),  0.5  sin(0.5t)).  So, 
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Figure  5.1:  Configuration  of 
a  car-like  robot 


Figure  5.2:  Communication 
graph  Q 


Figure  5.3:  Response  of 
(xij  —  xio)  for  1  <  i  <  5. 


Assumptions  5. 1-5.2  are  satisfied.  We  assume  that  the  communication  digraph  is  shown  in 
Fig.  5.2.  The  cooperative  controllers  can  be  obtained  with  the  aid  of  Theorem  5.1.  We 
choose  the  control  parameters  =  2,  k3  =  2,  bj  =  2 ,  pi  =  2,  and  p2  =  2.  Fig.  5.3  shows  the 
response  of  (xji  —  xio)  (1  <  j  <  5).  Fig.  5.4  shows  the  response  of  (x2]  —  x2o )  (1  <  j  <  5). 
Fig.  5.5  shows  the  response  of  (x-sj  —  x3o)  (1  <  j  <  5).  Figs  5.6  and  5.7  show  the  response 
of  YJj=\  xj  ~  Xq)  and  Y^=\  Vj  ~  Vo)-  The  simulation  results  show  that  the  formation 
control  problem  can  be  solved  with  the  aid  of  the  the  proposed  results  in  Theorem  5.1. 

If  the  communication  graph  is  time- varying  and  switches  according  to  the  following  logic 


Q 


Q  in  Fig.  5.8,  if  t  —  round (t)  >  0 
Q  in  Fig.  5.9,  if  t  —  round (t)  <  0 


the  control  laws  in  Theorem  5.3  solve  the  formation  control  problem.  Fig.  5.10  shows  the 
response  of  (xji  —  xio)  (1  <  j  <  5).  Fig.  5.11  shows  the  response  of  (x2j  —  x2o)  (1  <  j  <  5). 
Fig.  5.12  shows  the  response  of  (x3j  —  x30)  (1  <  j  <  5).  The  response  of  y-  —  ^o)  is 

shown  in  Fig.  5.13.  The  response  of  if  —  2/o)  is  shown  in  Fig.  5.14.  The  simulation 

results  show  that  the  formation  control  control  problem  can  be  solved  with  the  aid  of  the 
proposed  distributed  control  laws  in  Theorem  5.3. 


5.6  Conclusion 

This  chapter  has  discussed  the  leader- following  control  problem  of  multiple  nonholonomic 
systems  for  time-invariant  and  time-varying  communication  graphs.  With  the  aid  of  the 
properties  of  persistently  excited  signals  and  results  from  graph  theory  distributed  state 
feedback  control  laws  and  output  feedback  control  laws  were  proposed.  An  application  of  the 
proposed  results  to  formation  control  of  wheeled  mobile  robots  was  considered.  Simulation 
results  show  the  effectiveness  of  the  proposed  control  laws. 
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Figure  5.4:  Response  of  Figure  5.5:  Response  of 
(x2j  —  £20 )  for  1  <  i  <  5.  (x;ij  —  £30)  for  1  <  i  <  5. 


Figure  5.7:  Response  of 
(|  Ef=i  Vj  -  Vo)- 


Figure  5.8:  Communication 
graph  Q 


Figure  5.10:  Response  of  Figure  5.11:  Response  of 
(xij  —  £10)  for  1  <  i  <  5.  (x2j  —  £20)  for  1  <  i  <  5. 
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time  (sec) 

Figure  5.6:  Response  of 


Figure  5.9:  Communication 
graph  Q 


time  (sec) 


Figure  5.12:  Response  of 
(x3j  —  £30)  for  1  <  i  <  5. 
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Figure  5.13:  Response  of  Figure  5.14:  Response  of 
(T.U  f  ~  x«)'  (Sj.i  f  -  Vo)- 
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Chapter  6 


Distributed  Exponentially  Tracking 
Control  of  Multiple  Wheeled  Mobile 
Robots 


6.1  Introduction 

There  are  lots  of  applications  of  wheeled  mobile  robots  in  practice  and  control  strategies 
have  been  developed  for  decades.  Wheeled  mobile  robots  with  nonslip  constraints  are  typi¬ 
cal  nonhonomic  systems.  Stabilization  of  a  single  nonholonomic  system  is  challenging  due  to 
the  fact  that  no  smooth  pure  state  feedback  control  law  exists  for  stabilization.  Moreover, 
no  dynamic  continuous  time-invariant  feedback  controller  is  available  to  render  the  closed 
loop  system  locally  asymptotically  stable  [91].  With  the  efforts  of  researchers,  several  ap¬ 
proaches  have  been  proposed  for  stabilizing  nonholonomic  systems,  which  can  be  classified 
into  the  following  three  aspects,  namely,  discontinuous  time-invariant  feedback,  the  time- 
varying  feedback,  and  the  hybrid  feedback.  For  details,  see  [92]  and  the  references  therein. 

It  is  challenging  to  design  tracking  controllers  for  wheeled  mobile  robots  because  of  its 
nonlinear  feature.  Samson  and  Ait-Abderrahim  proposed  the  first  tracking  controller  for  a 
mobile  robot  in  [16].  Then  a  tracking  controller  was  designed  through  linear  approximation 
for  nonholonomic  systems  in  [93].  In  [94],  the  tracking  task  of  wheeled  mobile  robots  was 
fulfilled  by  linearizing  both  static  and  dynamic  feedback.  Fliess  et  al  solved  the  tracking 
problem  utilizing  results  of  “differentially  flat”  nonlinear  systems  [95].  With  the  aid  of 
backstepping  techniques,  semi-global  tracking  controllers  were  proposed  for  a  chained-form 
system  in  [17].  In  [96],  global  state  and  output  tracking  controllers  were  proposed  for  chained- 
form  systems  with  the  aid  of  Lyapunov  techniques.  Based  on  the  results  of  cascade  systems, 
linear  tracking  controllers  were  proposed  for  chained-form  systems  in  [18,97]. 

Due  to  the  practical  requirement  of  specific  tasks,  the  consensus  problem  without  a  leader 
has  been  extensively  studied  in  the  past  decades.  In  [32],  matrix  theory  was  applied  to  pro¬ 
pose  local  control  laws  for  fist-order  linear  discrete-time  systems  such  that  the  states  of 
multiple  systems  converge  to  a  constant  value.  In  [33],  Laplacian  matrix  of  a  communica¬ 
tion  graph  was  exploited  to  propose  local  control  laws  for  the  consensus  problem  of  multiple 
first-order  linear  continuous-time  systems.  In  [34] ,  consensus  algorithms  were  proposed  with 


relaxed  assumption  on  the  communication  graphs  in  [33].  Consensus  problem  with  a  leader 
has  also  been  studied  systematically  and  several  control  laws  have  been  proposed.  In  [43], 
consensus  problems  of  first-order  and  second-order  linear  systems  were  considered.  Dis¬ 
tributed  controllers  were  proposed  such  that  the  state  of  each  system  converge  to  a  desired 
trajectory  within  finite  time  under  the  condition  that  the  desired  trajectory  is  available  to 
a  portion  of  the  group  of  systems.  In  [72],  leader- following  consensus  of  high-order  linear 
systems  was  considered  over  a  switching  communication  topology.  Distributed  controllers 
were  proposed  with  the  aid  of  Riccati- inequality-based  approach.  In  [98],  consensus  control 
of  multi-agent  systems  was  considered.  Output  feedback  controllers  were  proposed  with  the 
aid  of  Hoo  theory.  In  [64],  consensus  of  high-order  linear  systems  was  considered  for  time- 
varying  and  directed  communication  topologies.  Distributed  controllers  were  proposed  with 
the  aid  of  the  observer  design  approach.  In  [65,66],  consensus  of  multiple  linear  systems 
was  considered  in  a  unified  viewpoint  and  a  notation  of  concensus  region  was  introduced. 
In  [73],  the  leader-following  consensus  problem  for  a  group  of  agents  with  identical  linear 
systems  subject  to  control  input  saturation  was  considered.  Linear  feedback  laws  were  pro¬ 
posed  for  fixed  and  switching  communication  topology.  In  [68,69],  consensus  of  first-order 
and  second-order  nonlinear  systems  was  considered.  Finite-time  control  laws  were  proposed 
with  the  aid  of  a  comparison  lemma.  In  [99],  cooperative  control  of  multiple  mobile  robots 
was  considered.  Distributed  control  laws  were  proposed  with  the  aid  of  consensus  approach. 

In  this  chapter,  we  study  distributed  formation  control  of  multiple  nonholonomic  wheeled 
mobile  robots  with  a  leader  whose  state  is  not  available  to  each  system  such  that  the  group 
of  robots  converges  to  a  desired  geometric  pattern  whose  centroid  follows  the  leader.  New 
distributed  control  laws  are  proposed  based  on  the  results  of  cascade  systems  and  the  prop¬ 
erties  of  persistently  exciting  signals.  Compared  to  the  results  in  [64-66,72,73,98],  in  this 
paper  cooperative  tracking  control  is  solved  for  multiple  nonlinear  systems.  Compared  to 
the  results  in  [99],  a  new  approach  is  proposed  for  cooperative  tracking  control  problem  of 
multiple  wheeled  mobile  robots  and  the  proposed  control  laws  can  make  the  tracking  errors 
uniformly  exponentially  converge  to  zero,  which  is  much  more  applicable  in  practice. 

The  remaining  parts  of  this  chapter  are  organized  as  follows.  In  Section  2,  the  considered 
problem  is  formulated  and  some  preliminary  results  are  presented.  In  Section  3,  distributed 
tracking  controllers  are  proposed,  in  Section  4,  controllers  are  proposed  for  switching  com¬ 
munication  graphs.  In  Section  5,  simulation  results  are  presented.  The  last  section  concludes 
this  paper. 


6.2  Problem  Statement 

It  is  considered  a  group  of  m  wheeled  mobile  robots  which  move  on  a  horizontal  plane.  The 
motion  of  robot  j  is  described  by 

Xj  =  Vj  cos  9j,  ijj  =  Vj  sin  03 ,  Qj  =  c Oj  (6.1) 

where  ( Xj,yj )  is  the  position  of  robot  j  in  a  coordinate  system,  9j  is  the  orientation  of  robot 
j,  Vj  is  the  speed  of  robot  j ,  and  c oj  is  angular  speed  of  robot  j.  The  control  inputs  are  v3 
and  ujj 
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For  m  system,  each  system  knows  its  own  state  and  its  neighbors’  states  by  communi¬ 
cation  and/or  sensors.  For  simplicity,  it  is  assumed  that  the  communications  between  the 
systems  are  bidirectional.  If  we  consider  each  system  as  a  node,  the  communication  between 
the  systems  can  be  described  by  a  (undirected)  graph  Q  =  {V,  £},  where  V  =  {1,  2, ... ,  m} 
is  a  node  set,  and  E  is  an  edge  set  with  unordered  pair  (i,j)  which  describes  the  commu¬ 
nication  between  node  i  and  node  j.  If  the  state  of  node  %  is  available  to  node  j,  node  i  is 
called  a  neighbor  of  node  j.  The  set  of  all  neighbors  of  node  j  is  denoted  by  A f3.  A  graph  is 
called  connected  if  for  any  two  different  nodes  there  exists  a  set  of  edges  which  connect  the 
two  nodes. 

A  formation  of  m  robots  is  defined  by  a  geometric  pattern  V.  The  pattern  V  can  be 
described  by  orthogonal  coordinates  ( PjxiPjy )  (1  <  j  <  m).  Without  loss  of  generality,  we 
assume  that  Y2jLiPjx  —  0  and  Yd'jLiPjy  —  0,  i.e.,  the  center  of  the  geometric  pattern  V 
is  at  the  origin  of  a  local  orthogonal  coordinate  system.  It  is  given  a  reference  trajectory 
qo(t)  =  (xo(t),yo(t),90(t))  which  satisfies 

x0  =  Vo  cos  60,  y0  =  Vo  sin  0o,  90  =  (v0  (6.2) 

where  vq  and  uq  are  known  time-varying  functions.  The  state  go  is  assumed  to  be  available 
to  a  portion  of  the  m  wheeled  mobile  robots. 

Let  qj  =  [xj,yj,6j]T ,  the  control  problem  considered  in  this  article  is  defined  as  follows. 

Control  Problem:  Design  a  control  laws  v3  and  c o3  for  system  j  using  its  own  state  q3, 
its  neighbor’s  state  qi,  the  relative  position  with  its  neighbor  ( Pix,Piy )  f°r  l  £  A/)-,  and  the 
desired  trajectory  g0  if  it  is  available  to  the  system  such  that 
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(6.3) 

(6.4) 

(6.5) 


for  1  <  i  7^  j  <  m. 

In  order  to  solve  the  defined  problem,  the  following  assumption  is  made  on  the  desired 
trajectory. 

Assumption  6.1.  The  (0  <  i  <  2)  are  bounded  and  f{+T  Oq (r)dr  >  fi  f°r  some  p  >  0 
and  T  >  0. 


6.3  Cooperative  Controller  Design 

Define  the  change  of  variables 

Zij  =  Oj,  z2j  =  (. Xj  —Pjx)  cos  Qj  +  (y3  -pjy)  sin  93,  z3j  =  (x3  -pjx)  sin  93  -  (y3  -pjy)  cos  93  (6.6) 
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for  0  <  j  <  m ,  where  A:3  >  0  and  p0x  =  p0y  =  0.  The  transformed  state  space  model  is 

*i  j  =  (6.7) 

z2j  =  vj  -  ujjZsj  (6.8) 

z3j  =  ujjZ2j.  (6.9) 

We  have  the  following  results. 

Lemma  6.1.  If  -  z10)  =  0,  lim t^00{z2j  -  z2 0)  =  0,  and  limt^.00(z3j  -  z30)  =  0  for 

1  <  j  <  m,  then  (6. 3) -(6. 5)  hold. 

System  (6.7)-(6.9)  can  be  considered  as  a  cascade  system  of  (6.7)  and  (6.8)-(6.9).  We 
first  design  control  law  uij  for  system  (6.7)  such  that  limt_>.0O(2:ij  —  ^io)  =  0.  For  a  group  of  m 
robots  (1  <  j  <m),  the  communication  between  robots  is  described  by  a  graph  Q  =  {A,Sj. 
Given  an  m  x  m  constant  matrix  A  =  [aji]  with  aji  =  aVJ  >  0,  the  Laplacian  matrix  £  =  [LJt] 
of  the  graph  Q  with  weight  matrix  A  is  defined  by 

— aji ,  if  i  G  Afj  and  i  ^  j 

0,  if  i  fL  Afj  and  i  ^  j 

Y.  aih  if  J  =  i- 

For  the  Laplacian  matrix,  the  following  result  is  useful  in  this  paper. 

Lemma  6.2  ([99]).  If  the  communication  graph  Q  is  connected,  then  ( L  +  cliag(p))  is  a 
positive  definite  symmetric  matrix,  where  constant  vector  p  =  [p\,  p2, . . . ,  fim]T ,  hi  £  0 
(1  <  i  <  m)  and  at  least  one  of  the  elements  of  p  is  nonzero. 

With  the  aid  of  Lemma  6.2,  we  have  the  following  lemma. 

Lemma  6.3.  For  the  {m  +  1)  systems  in  eqn.  (6.7)  (0  <  j  <  m),  if  the  communication 
graph  Q  is  connected  and  the  system  0  is  available  to  at  least  one  of  the  m  systems,  the 
control  laws 

Uj  =  fi]  ~  Y  aji(zi j  -  zn)  -  bjPj(zij  -  z10)  (6.10) 

ieATj 

j  =  —  Yj  —  6o) 

~Pij  sign  Y  ~  6i)  -  bjPj(fij  ~  ^io)  (6.H) 

i&ATj 

for  1  <  j  <  m  guarantee  that  limt^.00(^1j  —  zw)  '=  0  and  linp^00(n;J  —  ui0)  e=  0,  where 
6o  =  e0,  bj  >  0,  pij  is  sufficiently  large,  the  parameter  pj  =  1  if  system  0  is  available  to 
system  j  and  pj  =  0  if  system  0  is  not  available  to  system  j . 

The  proof  of  Lemma  6.3  is  the  same  as  the  proof  of  Lemma  4  in  [99]  and  is  omitted  here 
for  space  limitation. 

With  the  aid  of  Lemma  6.3  and  the  results  of  cascade  system,  we  have  the  following 
results. 
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Theorem  6.1.  For  the  (m  +  1)  systems  in  eqn.  (6.8)  (0  <  j  <  m),  under  Assumption  6.1, 
if  the  communication  graph  Q  is  connected,  then  the  distributed  control  laws  (6. 10)- (6. 11) 
and 


Vj  =  -k\z->j  -  k2uJjZ3j  +  UjZ3j  +  8,2 j 
82 j  =  —  X]  aji(&j  ~  £2 i)  —  bjtlj(£2j  —  £20) 

i&Mj 


sign 


y,  aji(8,2j  —  82 i)  +  bjHj(82j  —  £20) 

i&Mj 


(6.12) 


(6.13) 


for  1  <  j  <  m  ensure  that  {z\j,  z2j,  z:ij)  uniformly  exponentially  converges  to  (zw,  z2o,  z50) 
and  (81  j,  82 j)  exponentially  converges  to  (£10,  £20);  where  (3j  is  a  sufficiently  large  positive 
constant,  k\  >  0,  k2  >  0,  and 


820  —  V0  —  CUo^30  +  kiz2o  +  k2iVoZoo. 


(6.14) 


In  [99],  distributed  control  laws  for  multiple  wheeled  mobile  robots  were  proposed  such 
that  the  state  of  each  system  asymptotically  converges  to  a  desired  state.  In  this  paper,  new 
distributed  tracking  control  laws  are  proposed  with  the  aid  of  the  results  of  cascade  systems. 
Moreover,  the  proposed  control  laws  ensure  that  the  state  of  each  system  globally  uniformly 
exponentially  converges  to  a  desired  state. 

6.4  Simulations 

To  show  the  effectiveness  of  the  proposed  results,  simulation  has  been  done  for  three  robots. 
The  desired  geometric  pattern  V  is  shown  in  Fig.  6.1.  The  pattern  V  can  be  described  by 
orthogonal  coordinates  (pix,piy)  =  (-1,1.7),  (p2X,P2y)  =  (— 1,  — 1-T),  and  ( P3x,P3y )  =  (2,0). 
Assume  the  reference  trajectory  is  (xo,yo,6o)  =  (10 sin(0.5t),  — 10 cos(0.5f),  0.5t),  by  (6.2) 
t’o  =  5  and  u0  =  0.5.  So,  Assumption  6.1  is  satisfied. 

Assume  the  communication  graph  is  shown  in  Fig.  6.2.  The  cooperative  controllers  can 
be  obtained  by  Theorem  6.1.  We  choose  the  control  parameters  a]t  —  2,  k3  —  2,  bi  =  2, 
pi  =  2,  and  p2  =  2.  Fig.  6.3  shows  the  centroid  of  Xi  (1  <  i  <  3)  (i.e.,  J2^=1Xj/ 3)  and  xq. 
Fig.  6.4  shows  the  centroid  of  yt  (1  <  i  <  3)  (i.e.,  ]Cj=i  Vj/ 3)  and  r/o-  Fig.  6.5  shows  ( 6i  —  90) 
(1  <  i  <  3).  Fig.  6.6  shows  the  path  of  the  centroid  of  the  three  robots  and  its  desired  path. 
From  the  simulation  (6.4)-(6.5)  are  satisfied.  Eqn.  (6.3)  is  also  verified  and  the  response  of 
them  is  omitted  here. 


6.5  Conclusion 

This  chapter  has  discussed  the  formation  control  of  multiple  wheeled  mobile  robots  under  the 
condition  that  a  desired  trajectory  is  available  to  only  a  portion  of  the  systems.  Distributed 
control  laws  were  proposed  with  the  aid  of  Lyapunov  techniques  and  results  from  graph 
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x(m) 


Figure  6.1:  Desired  geomet¬ 
ric  pattern. 


Time  (sec) 


Figure  6.4:  Response  of  the 
centroid  of  yi  (solid)  for  1  < 
i  <  3  and  yo  (dashed). 


(T> - (2> - (0) 


Figure  6.2:  Information  ex¬ 
change  graph  Q 


Figure  6.5:  Response  of 
(Qi  —  9q)  for  1  <  i  <  3. 


Figure  6.3:  Response  of  the 
centroid  of  Xi  (solid)  for  1  < 
i  <  3  and  xq  (dashed). 


Figure  6.6:  The  path  of  the 
centroid  of  the  three  robots 
(dashed  line),  the  desired 
path  (solid  line)  of  the  cen¬ 
troid  of  robots,  and  forma¬ 
tion  of  the  three  robots  at 
several  moments  (red  trian¬ 
gles). 
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theory.  Simulation  results  show  the  effectiveness  of  the  proposed  control  laws.  In  this  paper, 
the  information  exchange  graph  is  assumed  to  be  bidirectional.  The  future  work  is  to  extend 
our  results  to  more  general  information  exchange  graphs. 
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Chapter  7 


Neural  Network  Based  Distributed 
Control  of  Mechanical  Systems 
with/ without  Constraints 

7.1  Introduction 

Wheeled  mobile  robots  (WMRs)  have  wide  spectrum  of  applications  in  civil  and  military 
areas.  Control  of  a  single  WMR  has  been  extensively  studied  in  the  past  decades  and  many 
control  algorithms  have  been  proposed  [92],  As  the  complex  of  tasks  increases,  some  tasks 
are  required  to  be  accomplished  by  multiple  WMRs  cooperatively.  Moreover,  compared  to 
a  single  WMR  system  a  system  consisting  of  multiple  WMRs  have  the  features  such  as  (a) 
reliable,  (b)  flexible,  (c)  scalable,  etc.  Considering  these,  cooperative  control  of  multiple 
WMRs  has  been  studied  by  researchers  in  the  past  decades.  Early  research  on  cooperative 
control  of  multiple  WMRs  is  based  on  the  assumption  that  all  information  of  each  WMR  is 
available  to  a  central  station  and  each  WMR  is  controlled  by  the  commands  from  the  central 
station.  This  type  of  cooperative  control  is  called  the  centralized  cooperative  control.  In 
centralized  cooperative  control,  control  algorithms  can  be  designed  by  considering  multiple 
WMRs  as  a  single  system  and  the  performance  of  the  whole  system  can  be  optimized. 
However,  in  centralized  cooperative  control  the  control  law  for  each  WMR  depends  on  the 
information  of  each  WMR,  which  means  that  the  centralized  cooperative  control  system  are 
not  scalable  and  are  not  robust  to  communication  failure. 

To  overcome  the  shortcomings  of  the  centralized  cooperative  control,  distributed  coop¬ 
erative  control  has  been  proposed.  In  distributed  cooperative  control,  there  is  not  a  central 
station  and  the  control  law  for  each  WMR  only  depends  on  its  neighbors’  information.  There 
are  many  distributed  cooperative  control  problems  in  practice.  An  important  problem  is  the 
leader-following  control  problem  where  there  are  multiple  WMRs  and  a  leader  WMR  whose 
information  is  only  available  to  a  portion  of  the  group  of  WMRs.  The  leader-following 
control  problem  is  to  design  a  distributed  control  law  for  each  WMR  using  its  neighbors’ 
information  such  that  each  WMR  follows  the  leader  WMR.  In  this  paper,  we  consider  the 
leader-following  control  of  multiple  WMRs.  In  order  to  design  control  laws,  the  dynamics 
of  each  WMR  should  be  known.  However,  in  practice  it  is  hard  to  obtain  the  dynamics 
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of  a  WMR  exactly.  Since  neural  networks  have  the  ability  of  approximating  a  unknown 
function,  we  apply  neural  networks  to  learn  the  unknown  parts  in  the  dynamics  and  then 
design  controllers  with  the  aid  of  the  approximation  of  the  neural  networks.  Furthermore,  we 
take  the  advantage  of  adaptive  control  into  our  controller  design  and  propose  on-line  tuning 
algorithms  for  the  neural  networks  in  the  controllers. 

7.1.1  Related  Work 

In  the  last  decades,  control  of  a  single  WMR  had  been  an  active  research  area.  An  important 
feature  of  a  WMR  system  is  that  the  number  of  its  inputs  is  less  than  the  number  of  its 
degree  of  the  freedom.  This  feature  makes  control  problems  of  a  WMR  challenging.  Tracking 
control  of  a  WMR  has  been  extensively  studied  and  various  control  laws  has  been  proposed 
with  different  methods  in  [16-18].  However,  these  control  laws  cannot  be  applied  to  the 
leader-following  control  multiple  WMRs. 

Cooperative  control  of  multiple  systems  has  been  studied  in  the  last  decades.  Various 
control  methods  have  been  proposed  in  its  early  research,  for  example  the  behavior-based 
method  in  [19,20],  the  virtual  structure  method  in  [21,22],  the  artificial  potentials  method 
in  [25,26],  and  the  graph  theoretical  method  in  [27,28].  As  one  of  cooperative  control 
problems,  leader-following  control  of  multiple  linear  systems  has  been  extensively  studied. 
For  multiple  first-order  linear  systems,  distributed  controllers  were  proposed  in  [41-44]  with 
the  aid  of  sliding  mode  control  and  adaptive  control.  For  multiple  second-order  systems, 
distributed  controllers  were  proposed  in  [43,44, 100].  For  multiple  high-order  linear  systems, 
the  leader- following  control  problem  was  studied  in  [71-74],  The  leader-following  control 
of  multiple  Lagrangian  mechanical  systems  was  considered  in  [101]  with  the  aid  of  graph 
theory.  The  leader-following  control  of  nonlinear  systems  has  also  been  studied.  For  multiple 
WMRs,  distributed  controllers  were  proposed  in  [99]  with  the  aid  of  a  transformation  based 
on  backstepping  techniques.  For  multiple  chained  form  systems  with  a  leader,  distributed 
tracking  controllers  were  proposed  in  [87]  with  the  aid  of  the  cascade  structure  of  each  system. 
For  multiple  first-order  and  second-order  systems  with  uncertainty,  distributed  controllers 
were  proposed  in  [102, 103].  For  multiple  linear  systems  with  uncertainty,  distributed  finite¬ 
time  tracking  controllers  were  proposed  in  [104]  with  the  aid  of  Lyapunov  techniques.  For 
multiple  uncertain  mechanical  systems,  distributed  tracking  controllers  are  proposed  in  [105]. 

7.1.2  Our  Contributions 

In  this  chapter,  we  consider  the  leader-following  control  problem  of  multiple  uncertain  me¬ 
chanical  systems  with/without  velocity  constraints.  In  order  to  solve  the  problem,  the  cas¬ 
cade  structure  of  each  system  is  explored  and  the  property  of  the  input-to-state  stability 
(ISS)  is  identified  for  each  system.  With  the  aid  of  the  ISS  property  and  the  passivity  prop¬ 
erty  of  each  system,  distributed  neural  network  based  tracking  controllers  are  proposed  with 
the  aid  of  neighbors’  information.  In  the  proposed  controllers,  the  unknown  dynamics  of  each 
system  is  approximated  by  neural  networks  and  the  state  of  the  leader  system  is  estimated 
with  the  aid  of  sliding  mode  control  and  adaptive  control.  The  contributions  of  this  article 
are  as  follows:  1)  the  leader-following  control  problem  is  solved  for  uncertain  mechanical 
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systems  with/without  velocity  constraints,  which  receives  less  attention  in  literature;  2)  a 
novel  ISS  based  approach  is  proposed  for  distributed  tracking  control  of  uncertain  dynamical 
systems  with  the  aid  of  neural  network  approximation  and  adaptive  distributed  estimation. 
The  proposed  approach  can  be  applied  solve  the  distributed  tracking  control  of  uncertain 
mechanical  systems  as  well  as  uncertain  mechanical  systems  with  constraints;  and  3)  an  ap¬ 
plication  of  neural  networks  in  distributed  cooperative  control  of  multiple  uncertain  WMRs 
is  presented  and  it  is  shown  that  neural  networks  have  potential  applications  of  distributed 
control  of  uncertain  nonlinear  systems. 

The  remaining  parts  of  this  chapter  are  organized  as  follows.  In  Section  7.2,  the  first 
problem  considered  in  this  article  is  defined  and  some  preliminary  results  are  presented.  In 
Section  7.3,  distributed  tracking  controllers  of  multiple  uncertain  mechanical  systems  with 
velocity  constraints  are  proposed.  In  Section  7.4,  the  proposed  controller  design  method  in 
Section  7.3  is  applied  to  solve  the  leader-following  control  of  uncertain  mechanical  systems. 
In  Section  7.5,  two  applications  of  the  proposed  results  are  considered.  Simulation  results 
are  presented.  The  last  section  concludes  this  article. 

7.2  Problem  Statement  and  Preliminary  Results 

7.2.1  Problem  Statement 

Consider  m  mechanical  systems  with  velocity  constraints.  The  j-th  system  is  defined  by 

^j{q*j)q*j  Gj{q*j,  +  Gj(q*j)  =  ^j(q*j)Tj  +  J{q*j)  At  (71) 

J(q*j)q*j  =  o  (7.2) 

where  q*j  =  [q\v  . . .  ,qnj]T  is  the  state  of  system  j,  Mj(q*j)  G  Rnxn  is  a  bounded  positive- 
definite  symmetric  matrix,  Cj(q*j,  q*j)q*j  is  centripetal  and  Coriolis  torque,  Gj(q*j)  is  a 
gravitational  torque,  Bj(q*j)  G  Rnxr  is  an  input  transformation  matrix,  t,  G  Rr  is  the 
control  input,  J(q*j)  G  U(B"s_1)xn  is  a  full  row  rank  matrix  with  s  —  n  —  1  —  Rank( J(q*j)), 
2  <  s  +  1  <  n,  r  >  s  +  1,  Xj  G  Rra_s_1  is  the  Lagrange  multiplier  which  expresses  the 
constraint  force  on  system  j,  and  the  superscript  T  denotes  the  transpose.  In  system  (7.1)- 
(7.2),  the  constraint  (7.2)  is  assumed  to  be  completely  nonholonomic  for  each  system  [3].  In 
the  dynamics,  Mj,  Cj ,  and  Gj  are  assumed  to  be  unknown  in  this  paper.  However,  dynamics 
(7.1)  has  the  following  properties  [106]: 

Property  7.1.  Mj  is  a  bounded  symmetric  matrix. 

Property  7.2.  Matrix  (. Mj  —  2Cj)  is  skew-symmetric  for  a  proper  definition  of  Cj.  This 
property  is  called  the  passivity  property  of  the  dynamics  (7.1). 

The  communication  between  the  systems  can  be  described  by  the  edge  set  £  of  a  directed 
graph  (or  digraph  for  short)  Q  =  (V,  £}  where  the  m  systems  are  represented  by  the  m  nodes 
in  V.  The  existence  of  an  edge  (l,j)  G  £  means  that  the  information  (the  state)  of  system 
l  is  available  to  system  j  for  control  (i.e.,  unidirectional  communication).  Bidirectional 
communication,  if  it  exists,  would  be  represented  by  the  edge  (j,  l )  also  being  in  the  edge  set 
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S.  The  symbol  Afj  denotes  the  neighbors  of  node  j  and  is  a  set  of  indices  of  the  systems  whose 
information  is  available  to  system  j.  A  directed  path  in  a  digraph  is  an  ordered  sequence  of 
vertices  such  that  any  ordered  pair  of  vertices  appearing  consecutively  in  the  sequence  is  an 
edge  of  the  digraph. 

It  is  given  a  desired  trajectory  q*tm+ 1  =  [(?i,m+i,  •  ■  • ,  ?n,m+i]T  which  is  generated  by  a 
leader  system 

Mm.+l  {q*,m+ 1  )Q*  ,m+ 1  +  Cm+ 1  ( q *  ,m+ 1-)  )(/*,m+l  ((?*,ra+l) 

=  ^m+1  (?*  ,771+1)^771+1  “1“  ^(9*, 771+1  )TAm+i,  (7.3) 

J \q*  ,m+l)  Q*  ,m+l  0  (7.4) 

where  Mm+1  G  Rnxn,  Cm+ 1  G  Rnxn,  Gm+1  G  /?",  and  _Bm+i  G  _Rnxr  are  known  matrices.  The 
input  rm+ 1  is  a  known  time-varying  function.  For  simplicity,  the  leader  system  (7.3)-(7.4)  is 
denoted  as  system  (m  + 1).  The  m  systems  in  (7.1)-(7.2)  and  the  leader  system  in  (7.3)-(7.4) 
can  be  considered  as  a  group  of  (m  +  1)  systems  and  the  communication  between  (m  +  1) 
systems  is  denoted  by  the  digraph  Qe  =  {Ve,£e}.  The  neighbor  set  of  node  j  is  denoted  by 
A fj.  Since  the  leader  system  does  not  receive  information  from  other  systems,  the  neighbor 
set  of  node  (m  +  1)  is  an  empty  set,  i.e.,  A f^+i  =  0.  Node  (m  +  1)  is  reachable  to  node  j 
( j  +m  +  1)  if  there  exists  a  directed  path  from  node  (m  +  1)  to  node  j.  Node  (m  +  1)  is 
said  to  be  globally  reachable  if  node  (m  +  1)  is  reachable  to  node  j  for  1  <  j  <  m.  In  this 
paper,  the  following  assumption  is  made  on  the  communication  digraph  Qe. 

Assumption  7.1.  In  the  communication  digraph  Qe,  node  (m  +  1)  is  globally  reachable. 

The  control  problem  that  will  be  discussed  first  is  defined  as  follows. 

Leader-following  control:  For  m  systems  in  (7.1)-(7.2)  and  a  leader  system  in  (7.3)-(7.4), 
the  control  problem  is  how  to  design  a  control  law  Tj  for  system  j  using  its  own  state  (q*j,  q*j) 
and  its  neighbor’s  state  (g*j,  <+)  f°r  *  £  Aff  such  that 

lim  (q*j(t)  -  q*,m+i(t))  =  0  (7.5) 


for  1  <  j  <  ru¬ 
in  the  leader- following  control  problem,  the  state  of  each  system  is  available  to  itself  and 
its  neighbors.  The  desired  state  q*,m+ 1  is  only  available  to  a  subset  of  a  group  of  the  systems, 
which  make  the  leader-following  control  problem  challenging. 

7.2.2  Some  Results  on  Linear  time-varying  systems 

Throughout  this  article,  ||  •  ||  stands  for  the  Euclidean  norm  of  vectors  and  induced  norm  of 
matrices.  Fora:  =  [aq, . . . ,  xn]T ,  \x\  =  [|aq|, . . . ,  |a;n|]T,  sign+)  =  [sign(aq), . . . ,  sign(a+]T, 
and  diag(x)  is  a  diagonal  matrix  with  the  element  in  the  main  diagonal  being  x.  0  is  a  vector 
or  matrix  with  each  element  being  zero  and  with  an  appropriate  dimension.  1  is  a  vector 
with  each  element  being  one  and  with  an  appropriate  dimension.  For  a  symmetric  matrix 
B  G  Rnxn,  \min(B)  denotes  the  smallest  eigenvalue  of  B  and  denotes  the  largest 

eigenvalue  of  B.  We  denote  by  Br  the  open  ball  Br  :=  {x  G  :  ||a;||  <  r}.  A  function 
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a(s)  :  3?>o  — *  9ft>0  is  said  to  be  of  class  K,  (a  G  1C),  if  it  is  continuous,  strictly  increasing 
and  zero  at  s  —  0.  Moreover,  if  a(s)  — »  oo  as  s  — »  oo  we  say  that  a  G  /C^.  The  origin 
of  the  system  x  =  f(t,  x )  is  globally  uniformly  stable  (GUS)  if  there  exists  a  G  /Coo  such 
that  1 1 x ft)  ||  <  a(||a;o||)  for  all  t  >  t0  and  all  to  >  0.  It  is  uniformly  globally  asymptotically 
stable  (UGAS)  if  in  addition  to  GUS,  for  each  r  and  e  >  0,  there  exists  T(r,  e)  >  0  such  that 
ft o,x0)  G  3?>o  X  Br  implies  that  ||a;(t)||  <  e  for  all  t  >  t0  +  T.  The  origin  of  the  system  is 
said  to  be  globally  uniformly  exponentially  stable  (GUES)  if  there  exist  two  strictly  positive 
constants  71  and  y2  such  that 


\\x(t,t0,x0)\\  <  7i||xo||e  72(*  to) 

for  any  initial  condition  x0(t0)  and  t  >  t0.  A  function  (pit)  G  3?  is  said  to  be  persistently 
excited  (PE)  if  there  exist  n  >  0  and  T  >  0  such  that 

rt-\-T 

J  pirydr  >  n,  Vt  >  0. 

For  a  PE  signal,  the  following  lemma  will  be  applied  in  this  paper. 

Lemma  7.1.  (Lemma  4-8-3  in  [5])  Signal  £i(t)  is  a  PE  signal,  if  £2(Z)  is  bounded  and 
converges  to  zero,  then  £1  +  £2  is  a  PE  signal. 

For  a  linear  time-varying  system,  we  have  the  following  results. 

Lemma  7.2.  ([87])  For  a  linear  time-varying  system 


[  Xi  =  -C1X1  ~  C2<t>(t)x 2  -  C3X3  H - 

l  -  c^t^-^xi-i  ~  Q0(t)mod(i’2)X;  (7.6) 

[  X2  =  Xi,---,Xi  =  X1-1 

where  mod(/,  2)  denotes  the  remainder  of  the  Euclidean  division  of  l  by  2,  and  constants  Ci 
(1  <  i  <  l)  are  chosen  such  that  the  polynomial 

X1  +  c\\l  +  •  •  •  +  Ci— iA  +  q  (7.7) 

is  Hurwitz  (i.e.  all  roots  are  in  the  left  half  of  the  open  complex  plane),  if  pit)  is  an  absolutely 
continuous  PE  signal  and  maxte[O)oo){|0(OI>  —  Pm  <  00  almost  everywhere,  then  the 

system  (7.6)  is  GUES. 

Lemma  7.3.  For  the  system 

x  =  A(t)x  +  F(t)  (7.8) 

where  Aft)  is  bounded  and  x  =  A(t)x  is  GUES.  If  F(t)  is  bounded  and  converges  to  zero, 
then  the  system  (7.8)  is  GAS. 
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Proof:  Since  cc  =  A(t)x  is  GUES  and  Aft)  is  bounded,  by  Theorem  7.8  in  [61] 

/OO 

$^0,  t)$A(v,  t)da 

is  a  continuously  differentiable  symmetric  matrix  for  all  t  and  is  such  that 

Vi1  <  Q(t)  <  ml  (7-9) 

AT  (t)Q(t)  +  Q(t)A(t )  +  Q(t)  <  —773/  (7-10) 

where  r/i ,  772,  and  773  are  finite  positive  constants,  and  <f>((x,  t)  is  the  state  transition  matrix 
of  the  system  x  =  A{t)x.  Let  V{t)  =  xTQ(t)x  and  differentiate  it  along  the  solution  of  the 
system,  we  have 

V  =  xt(QA  + AtQ +  Q)x  +  2xTQF 

<  -r l3xTx  +  2 xtQF  <  m—V  +  r)4W\\F\\ 

Vi 

where  774  is  a  positive  constant.  By  the  comparison  lemma  [90],  it  can  be  shown  that  V 
converges  to  zero  if  F  converges  to  zero.  Therefore,  x  converges  to  zero.  ■ 


7.2.3  Some  Results  of  Algebraic  Graph  Theory 

For  the  digraph  Qe  with  a  weight  matrix  Ae  =  [ap](rn+i)x(m+i)  (dji  >  0),  its  weighted 
Laplacian  matrix  £e  =  [L|J(,n+i)x(m+i)  is  defined  as 

{—  dji,  if  i  7^  j  and  i  G  Afj 

0,  if  i  ^  j  and  i  A 7/  n* 

X  aik,  if  '  J- 

k&ATj 

For  the  digraph  Q  with  the  weight  matrix  A  which  is  formed  by  the  first  m  rows  and  the 
first  777  columns  of  Ae,  its  weighted  Laplacian  matrix  £  =  [L3f\mYrn  is  defined  as 


■'31 


—aji,  if  i  7^  j  and  i  G  Afj 

0,  if  1  7^  j  and  i  ^  Afj 

J2  ajk,  if  i  =  j. 

keMj 


By  the  dehnition, 


where 


re 

*-11 

_ £e 

*-12 

£  +  diag(£®2) 

_ £e 

*-12 

0 

0 

0 

0 

C 

£ 


e 

11 


e 

12 


12) 


£  +  diag(£ 

[®l,m+ lpli  ■  ■  ■  j  ®m,m+ 1  £rn] 


T 


(7.12) 


(7.13) 
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(7.14) 

(7.15) 


and 


1,  if  node  (m  +  1)  is  available  to  node  j 
0,  otherwise 


(7.16) 


ft  = 


for  1  <  j  <  m. 

For  the  weighted  Laplacian  matrix  Ce,  the  following  results  will  be  applied  in  this  paper. 

Lemma  7.4.  ([38,  87])  For  the  digraph  Qe  with  weighted  matrix  Ae  =  [aji](m+i)x(m+i)  ( ap  > 
Oj,  its  weighted  Laplacian  matrix  Ce  is  defined  in  (7.11).  If  node  (m+ 1)  is  globally  reachable, 
then 

1.  Ce  1  =  0; 

2.  zero  is  a  simple  eigenvalue  of  Ce  and  non-zero  eigenvalues  of  Ce  all  have  positive  real 
parts; 

3.  -Ceu  is  a  Hurwitz  matrix; 
f.  Let 

P  =  (diag((£^)_1l))  1  =  diagQPi,  ...,Pm  J), 

then  P  and 

Q  =  PCI,  +  ( Ceu)TP 

are  positive  definite  matrices. 


With  the  aid  of  Lemma  7.4,  the  following  results  can  be  obtained. 

Lemma  7.5.  For  the  digraph  Qe  with  the  weight  matrix  Ae  =  [ajj](m+i)x(m+i)  (ap  >  0/, 
consider  the  system 

ij  =  -  E  -  -)  +  dj,  1  <j<m  (7.17) 

ie Me 

where  fj  G  R,  dj  is  bounded  and  ( dj  —  £m+i)  exponentially  converges  to  zero.  If  node  (m+  1) 
is  globally  reachable,  —  ^m+i)  globally  uniformly  exponentially  converges  to  zero  for  1  < 
j  <  m. 

Proof:  Let  —  fm+i  f°r  1  <  j  <  m  and  f  =  [£i, . . .  ,^m]T,  then  (7.17)  can  be 

written  in  a  compact  form  as 

I  =  +  [di,  ■  ■  • ,  dm]r  -  6n+1l.  (7.18) 

Since  —  C\,  is  a  Hurwitz  matrix  by  Lemma  7.4,  system  (7.18)  is  a  perturbation  of  a  stable 
linear  system  with  an  exponentially  decaying  disturbance  ([d,, . . . ,  dm]T  —  £m+1l).  Therefore, 
the  system  (7.18)  globally  uniformly  exponentially  converges  to  zero.  ■ 
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Lemma  7.6.  For  the  digraph  Qe  with  the  weight  matrix  Ae  =  [aji](m+i)x(m+i)  (aji  >  0), 
consider  the  system 


ij  =  ~  Y,  MO  -  &)  -  Pi  si§n  5]  MO  ~  0 


(7.19) 


ieAfe 


VieAfe 


where  G  R  for  1  <  j  <  m  +  1. 

1.  If  node  (■ m  +  1)  is  globally  reachable  and 

Pi(t )  >  \L+l(t)\.  (7.20) 

then  —  £m+i)  globally  uniformly  exponentially  converges  to  zero  for  1  <  j  <  m. 


2.  If  the  communication  between  node  j  and  i  for  1  <  j  ^  i  <  m  are  bidirectional,  node 
(m+  1)  is  globally  reachable,  |£m+i|  is  bounded,  and 

P  =  diag(7)|£^f|.  (7.21) 

where  p  =  [pi, . . . ,  pm]T ,  7  =  [7i>  •  •  •  ,7m]0  7 i  >  0  for  1  <  i  <  m,  and  f  =  [£i  - 
£m+i, . . . ,  On  —  6n+i]T;  then  (fj  —  £m+i)  asymptotically  converges  to  zero  for  1  <  j  <  m 
and  p  is  bounded. 


Proof:  1.  Let  s  =  £^0  then 

s  =  -  £  i j  cliag ( p) sign ( s )  -  diag^M+i1 


where  we  apply  the  fact  that  Cl  =  0.  Choose  a  Lyapunov  function  candidate  V  =  sT Ps 
where  P  is  defined  in  Lemma  7.4,  we  have 


V  = 


< 

< 

< 


-sTQx  -  2sTP£®1diag(p)sign(s)  -  2sTPdiag(£'f2)0n+il 

— sTQx  —  2,sT  P£diag(p)  sign  ( s)  —  2sTP£'j;2diag(p)sign(,s)  —  2sTPdiag(£i2)0n+il 

m 

—stQx  -  2sT P £diag(p)sign(s)  -  2^Pjaj^n+lpj\sj\(pj  -  |0n+i|) 

3= 1 


s  Qx  —  2s  P£diag ( p) sign ( s ) 


stQx  < 


^ min  (Q  ) 
max  (£*) 


V 


Therefore,  V  exponentially  converges  to  zero.  So,  (£j— On+i)  globally  uniformly  exponentially 
converges  to  zero  for  1  <  j  <  m. 

2.  Equation  (7.19)  can  be  written  as 


i 


— £nl  -  diag(p)sign(s)  -  On+i1 


Since  the  communication  between  node  j  and  i  for  1  <  j  ^  i  <  m  are  bidirectional  and  node 
(m  +  1)  is  globally  reachable,  £)1  is  a  symmetric  positive  definite  matrix.  Let  a  constant 
M  >  £m+i(t)  for  any  t,  we  choose  a  Lyapunov  function  candidate 

m 

V  =  ccu  +  Y.-i]\P:,-M)'2. 

3= 1 
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Differentiate  V  along  the  solution  of  the  system,  we  have 


V  =  -2lT(^n)2|-  2|T£f1diag(p)sign(s) 

m 

-2|T^iem+il  +  2  x: 7 J\pj  -  M)p, j 

3= 1 

m  m 

=  -2{T(£i.)2t  -  E2|e„+,i»3 

m 

+2Y,^71(pj  ~M)Pj 

3= 1 

m  m 

<  -2fT(£;,)2t -  2EftW  +  E2iwil»jl 

.i  i  .i  i 

m 

+2J2^71(pj  ~M)pj 

3= 1 

m 

m  m 

-  E2(M  -  |£m+1|)|Sj|  +  2E7j1(pj  -  M)p, 

m 

<  -2fT(£;,)2t-2E(ft-M)|Sj| 

m 

+2J2^71(pj  -  m)pj 

3=1 

=  -2iT(£en)2i<  o  (7.22) 

which  means  that  D  is  bounded.  Therefore,  £  and  pj  are  bounded.  By  integrating  both 

sides  of  (7.22),  £  is  square- integrable.  Since  £  is  bounded,  by  Barbalat’s  lemma  £  converges 
to  zero.  ■ 

7.2.4  Neural  Network  Approximation 

The  multilayer  neural  network  (NN)  is  modeled  with  the  aid  of  the  structure  of  biological 
nervous  systems  [107].  It  is  a  nonlinear  function  which  can  map  an  input  space  Rp  into 
an  output  space  Rq.  The  NNs  have  the  abilities  of  function  approximation,  learning,  gen¬ 
eralization,  classification,  etc.  A  two-layer  neural  network  is  shown  in  Fig.  7.1.  It  has  a 
hidden  layer  with  l  neurons  and  an  output  layer  with  q  neurons.  The  input  vector  x  has  p 
components.  Input  1  is  for  considering  thresholds.  The  output  of  the  neural  network  can  be 
written  as 


1 

y  =  [yi,...,yq}T  =  WT 

<t>  (vT 

'  i ' 

) 

L  V 

X 

J  J 
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where  matrices  V  and  W  are  the  hidden  layer  and  the  output  layer  weights  and  thresholds 
and  0  is  the  activation  function  of  neutrons.  In  W,  the  elements  in  the  first  row  are  thresholds 
of  the  output  layer  and  the  elements  in  other  rows  are  weights  of  the  output  layer.  In  V, 
the  elements  in  the  first  row  are  thresholds  of  the  hidden  layer  and  the  elements  in  other 
rows  are  weights  of  the  hidden  layer.  For  the  sake  of  simplicity,  the  above  equation  can  be 
written  as 

y  =  WT(f)  (vTx) 

by  redefining  the  activation  function  0  and  x.  For  the  activation  function  there  are  different 
choices  ([108,109]).  Typical  choices  are 

1.  sigmoid  function:  0(s)  =  1  , 

2.  hyperbolic  tangent  function:  0(s)  =  , 

3.  radial  basis  function:  0(s)  =  e  ( ^  a)  , 

4.  etc. 

A  multilayer  neural  network  can  be  applied  to  approximate  a  nonlinear  function.  For 
a  contunous  function  f(x)  :  hi  — >•  Rq  and  a  small  positive  number  e  where  hi  is  a  compact 
subset  of  Rp ,  it  has  been  proven  in  [110]  that  there  exists  a  sufficiently  large  number  l  of 
neurons  in  the  hidden  layer  with  suitably  selected  activation  function  0  and  weights  and 
thresholds  such  that  one  has 


\\f(x)  —  WT 4>{V1' x)\\  <  e 


(7.23) 


for  any  x  G  fh  Let 

e{x)  =  f(x)  -  wT 4>{vT x) 

E(x )  is  called  the  NN  functional  reconstruction  error  vector.  In  order  to  choose  a  suitable 
NN  to  approximate  f(x),  one  needs  to  suitably  select  the  activation  function  0,  the  number 
of  neurons  in  the  hidden  layer,  and  weights  and  thresholds.  The  NN  is  a  nonlinear  function 
of  the  parameter  V,  which  means  that  the  selection  of  V  is  hard.  The  NN  is  a  linear  function 
of  parameter  W.  It  can  be  shown  that  if  the  weight  matrix  V  are  suitably  selected  and  is 
fixed  it  is  possible  to  select  weight  matrix  W  such  that  (7.23)  holds  ([111,112]).  Actually, 
this  fact  can  be  easily  proved  with  the  aid  of  the  first-order  Taylor  approximation  formula 
at  sufficient  dense  points  in  hi. 

In  this  paper,  we  will  assume  that  the  activation  function  0,  the  number  of  neurons  in  the 
hidden  layer,  and  the  weight  matrix  V  have  been  chosen  and  are  known.  While  the  weight 
matrix  W  is  unknown.  For  convenience,  <fi(yT  x)  will  be  denoted  by  0(x).  The  optimal 
weight  matrix  W  of  IT  for  approximation  is  defined  as 

W  =  arg  min  (sup  \\f(x)  —  WTcj)(x)\\}. 
w  xen 

If  f(x)  is  a  known  function,  the  optimal  weight  matrix  W  can  be  obtained  explicitly  as 
a  function  of  f(x)  and  (f>(x)  with  the  aid  of  different  optimization  methods.  If  f(x)  is  an 
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1 


input  Hidden  Layer  Output  Layer 

Figure  7.1:  Architecture  of  a  two-layer  neural  network  [107] 


unknown  function,  one  cannot  obtain  W  as  a  function  of  f{x)  and  (f>(x).  In  order  to  obtain 
an  estimate  of  W,  one  way  is  to  train  the  NN  by  the  training  algorithms  as  in  [111,113]. 
Another  way  is  to  design  online  tuning  algorithms  as  in  [107, 114]  with  the  aid  of  Lyapunov 
stability  theory.  In  this  paper,  we  will  propose  an  online  tuning  algorithm  for  W. 

7.3  Distributed  Controller  Design 

To  solve  the  cooperative  control  problem,  we  convert  the  systems  in  (7.1)-(7.2)  and  (7.3)- 
(7.4)  into  a  suitable  form.  For  1  <  j  <  m+ 1,  let  the  vector  fields  gi(q*j),  ■  . . ,  gs+i(q*j)  form  a 
basis  for  the  null  space  of  J(q*j).  Then,  by  (7.2),  there  exists  a  vector  u*j  =  [«ij, . . . ,  us+ ij]T 
such  that 

q*j  g(q*j)u*j  gi (q*j)uj\j  T  ■  ■  ■  T  g s+i{q*j)^s+i,j  (7.24) 

where  g(q*j )  =  [gi(q*j),  ■  ■  ■ , gs+i(q*j)]  £  /jmx0+1).  Differentiating  both  sides  of  (7.24)  and 
substituting  it  into  (7.1)  and  multiplying  on  the  left  by  gT{q*j),  we  have 

T/j (q*j) h -(-  C j(q*j j  q*j')u*j  T  G j (,q*j)  ^ j (q*j ) D  ( 7 . 2 5 ) 

where  we  have  used  the  fact  that  gT (q*j)JT (q*j)  =  0,  and 

Mj(q*j)  =  5T(e*j)-Mj(?*i)^(9*j) 

Gj (q*j ,  q*j )  =  gT{q*j)Mj(q^j)g(q^j)  +  gT(q*j)Cj(q^j,q^j)g(q^j) 

Gj(q*j)  g  (q*j)Gj(q*j) 

Bj{q*j )  =  gT(q*j)Bj(q*j). 

Based  on  Property  7.2  of  dynamics  (7.1),  the  following  property  can  be  easily  proved: 
Property  7.3.  Matrix  Mj  —  2 Cj  is  skew- symmetric. 

The  reduced  system  (7.24)-(7.25)  describes  the  motion  of  the  system  (7.1)-(7.2).  There¬ 
fore,  the  leader-following  control  problem  can  be  considered  based  on  the  systems  in  (7.24)- 
(7.25).  In  order  to  completely  actuate  each  nonholonomic  system,  Bj(q)  is  assumed  to  be 
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a  full  rank  matrix.  (7.24)  is  called  the  kinematics  of  system  j,  while  (7.25)  is  called  the 
dynamics  of  system  j. 

To  simplify  the  leader- following  control  problem,  we  assume  that  eqn.  (7.24)  has  two 
inputs  and  is  in  the  following  chained  form  after  suitable  state  and  input  transformations 

qij  =  ui  j,  (7.26) 

q2j  =  u2j,  =  uijfc-ij,  3  <  i  <  n.  (7.27) 

For  the  leader  system,  the  following  assumption  is  made. 

Assumption  7.2.  For  the  system  (m+ 1)  in  (7. 25)- (7. 27),  U\>m+ \  is  an  absolutely  continuous 
PE  signal  and  maxte[0)oo){|wi,m+i(OI>  |fti,m+i(OI}  <  00  almost  everywhere.  q^m+\  and  q^m+ i 
are  bounded  for  2  <  i  <  n  —  1. 

We  design  distributed  control  laws  based  on  the  backstepping  techniques  and  the  ap¬ 
proximation  property  of  neural  networks.  In  the  first  step,  it  is  assumed  that  (u\j,  u2j)  is 
a  control  input  for  system  j  in  (7.26)-(7.27)  and  we  design  a  distributed  control  for  it  such 
that  (7.5)  holds.  In  the  second  step,  we  design  distributed  controller  t3  such  that  (7.5)  holds 
with  the  aid  of  the  results  in  step  1. 

•  Step  1  :  The  system  in  (7.26)-(7.27)  is  a  cascaded  system.  The  subsystem  in  (7.26)  is 
a  first-order  linear  system  and  the  subsystem  in  (7.27)  is  a  linear  time-varying  system.  We 
take  this  advantage  in  controller  design.  For  (m  +  1)  linear  systems  in  (7.26),  we  propose 
the  distributed  controller  for  system  j  as 


uij  —  Vi  j 


(7.28) 


where 


j  —  aji(qij  qu)  "h  £i j  (7.29) 

ieAT; 

fij  is  an  estimate  of  q^m+\  and  will  be  designed  later  such  that 

lim^-^+i)  =p  0  (7.30) 

£—>■00 

where  C=P  means  ” exponentially  converges  to”.  Let 

Ql  j  Qlj  9l,m+l? 

with  the  control  law  (7.28),  we  have 

fij  =  -  aji(qij  ~  qu)  +  6 j  ~  qi,m+i-  (7-31) 

ieAT; 

Under  Assumption  7.1,  by  Lemma  7.5  (qj  —  qm+ 1)  uniformly  exponentially  converges  to  zero 
for  1  <  j  <  m.  Therefore,  U\3  exponentially  converges  to  wijJ7l+i  and  is  a  PE  signal. 


For  (m  +  1)  linear  time- varying  systems  in  (7.27),  we  propose  a  distributed  control  law 
for  system  j  as 


-  'I’.j 


(7.32) 


where 


I l‘2j  l'>q!j  k^Uijqsj  •  •  •  knUy  -  tjnj  T  X 1 J 

Xij  is  an  estimate  of 


(7.33) 


A  —  <j2,m+l  +  &2<Z2,m+l  +  k3U\^m+\q3^m+\  +  '  '  ' 

i  U  mod(n,2) 

rA'nu'lJm+l 


(7.34) 


and  will  be  designed  later  such  that 

lim  (*„  -  A)  S'  0  (7.35) 

and  k2l  ■  ■  ■ ,  kn  are  chosen  such  that  the  polynomial 

An_1  +  k2\n~2  +  •  •  •  +  +_+  +  kn  (7.36) 

is  Hurwitz.  Let  gy,-  =  —  gym+i  for  2  <  i  <  n,  with  the  control  law  (7.32),  we  have 

q-2j  =  -hh]  -  k3uijq3j - knu™d(n'2)  qnj  +  Xij 

n 

-A-  h{un  -  Uhm+l)qi,m+\  (7.37) 

odd  1=3 

Qij  uijqi-ij  +  {vj\ j  ^i,m+i)%— i,m+ij  (7.38) 

3  <  i  <  n. 


The  system  in  (7.37)-(7.38)  can  be  considered  as  a  perturbation  of  the  following  linear  time- 
varying  system 

q2 j  =  ~k2q2j  -  k3u3jq3j - knuj°d(n’2) qnj  (7.39) 

q%j  =  uijqi-ij,  3  <i<n.  (7.40) 


with  the  perturbation 


A 


n 

Xij  -A-  ^  ^ 

odd  1=3 

,771+1 


(7.41) 


|_  (ill  j  Ml,m+l)g  n—  l,m+l  J 

Since  My  is  a  PE  signal,  by  Lemma  7.2  the  system  (7.39)-(7.40)  is  GUES.  Since  A  is 
bounded  and  converges  to  zero,  by  Lemma  7.3  the  system  (7.37)-(7.38)  is  GAS.  Therefore, 
qij  converges  to  zero  for  2  <  i  <  n. 
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To  summarize,  for  system  (7.26)-(7.27)  the  controllers  (7.28)  and  (7.32)  with  rjij  defined 
in  (7.29)  and  r/2j  defined  in  (7.33)  ensure  that  (7.5)  hold. 

•  Step  2  :  u\j  and  U2j  were  not  the  real  control  input.  They  cannot  be  chosen  to  be  r]ij 
and  rj2j-  Let  u\3  =  u\3  —  rfrj  and  U2j  =  «2j  —  V2 jy  the  systems  in  (7.31),  (7.37)-(7.38),  and 
(7.25)  can  be  written  as 


Qlj  =  ~  aji(Q\ 3  ~  <?1 i)  +  Clj  ~  Ql,m+1  +  Uij  (7.42) 

ieA/i 


q2j  =  ~hq2j  ~  k3ul3q3j - knuf°d{n,2)  qnj  +  u2j 

Tl 

Xlj  ^  ^  y  klip'll 

(7.43) 

odd  1=3 

Qij  {y*lj  ^l,m+l)%—  l,ra+l j  3  ^  Z  ^  72. 

(7.44) 

Mj(q*j)u*j  =  Bj(q*j)rj  —  Cj(q*j ,  q*j)u*j 

—  +  CjT)*j  +  Gj) 

(7.45) 

where  u*3  =  [uij,u2j]T  and  rj*j  =  [qij,V2j]T- 

For  the  system  in  (7.42)- (7.44),  the  following  ISS  property  can  be  shown. 

Lemma  7.7.  For  the  system  in  (7. 42) -(7. 44),  under  Assumptions  7. 1-7. 2,  if 

1.  £1  j  is  bounded  and  (7.30)  is  satisfied, 

2.  xij  is  bounded  and  (7.35)  is  satisfied, 

3.  u\j  and  u,2j  are  bounded  and  converge  to  zero, 
then  q*j  converges  to  zeros. 

Proof:  If  (7.30)  is  satisfied,  (7.42)  is  a  perturbation  of  the  system  (7.31)  with  the 
perturbation  u\j.  Since  the  system  (7.31)  is  GUES,  c]\3  converges  to  zero  if  U\3  is  bounded 
and  converge  to  zero  by  Lemma  7.3.  Furthermore,  U\3  is  a  PE  signal  by  Lemma  7.1. 

If  (7.35)  is  satisfied,  (7.43)-(7.44)  is  a  perturbation  of  the  system  (7.39)-(7.40)  with  the 
perturbation  u2j  and  A  j.  Since  u\j  is  a  PE  signal,  the  system  (7.39)-(7.40)  is  GLIES  by 
Lemma  7.2.  By  Lemma  7.3  ql3  converges  to  zero  if  U2j  is  bounded  and  converge  to  zero.  ■ 
With  the  aid  of  Lemma  7.7,  we  design  a  distributed  controller  t3  for  (7.45),  £1  3,  and  \j 
such  that  the  conditions  required  in  Lemma  7.7  are  satisfied.  In  (7.45), 

fj(xj)  =  q^)rj^  +  Gfiq^)  (7.46) 

is  unknown,  where  x3  =  [qjj,  qjj,  'qfrj ,  rjJj]T ■  fj{xj)  is  a  static  function  of  x3.  A  neural  network 
can  be  applied  to  approximate  it.  We  choose  a  suitable  activation  function  (t>3  and  suitable 
weights  and  thresholds  in  the  hidden  layer  for  a  NN.  For  an  optimal  weight  and  threshold 
matrix  W*j  of  the  NN, 


+  e3. 


(7.47) 


where  the  optimal  parameter  matrix  is  defined  by 


W*j  =  arg min{ sup  \\fjixj)  -  U"  o,(.r,)l  } 

w*j  Xjm 

and  6j  is  a  positive  constant  such  that 

II fj(xj)  -  Wjjfaixj) ||  <  Ej.  (7.48) 

It  should  be  noted  that  e3  is  small  if  the  number  of  the  neurons  in  the  hidden  layer  is  large 
and  W*j  is  unknown. 

With  the  approximation  of  the  neural  network,  (7.45)  can  be  written  as 

( q*j )  Bj  (/i-t-.j )  Xj  C j  ( ((xj ,  q*j)  u*j 

-Wjs<h(xi)  ~  (j-  (7-49) 

We  choose  the  control  law 

Tj  =  Bj1(qmj)  \-KpUtj  +  Wjjfijixj)  -  p3jSign('u*j)J  (7.50) 

where  Kp  is  a  positive  definite  symmetric  matrix,  W*j  is  an  estimate  of  W*j  and  will  be 
designed  later,  and  p3j  is  a  positive  constant  such  that 

P3j  >  €j.  (7.51) 

With  the  control  law  (7.50),  we  have 

Mj(q*j)u*j  =  —Kpu*j  —  Cj(q*j,q*j)u*j 

+  (W*j  -  W.jfh  -  p3jSign(u*j)  -  6j.  (7.52) 

The  update  law  is  chosen  to  be 

^ ^ -T (7.53) 

where  Tj  is  a  positive  definite  symmetric  matrix.  To  prove  the  stability  of  the  closed-loop 
system  with  the  proposed  control  law  and  update  law,  we  choose  a  Lyapunov  function 
candidate 

1/  =  +  iir((W*j  -  W.j)Trj1(W.j  -  W^))  (7.54) 

where  tr(-)  denotes  the  trace  of  its  variable.  Differentiate  it  along  the  solution  of  the  closed- 
loop  system,  we  have 

V  =  -uJjKpu*j  +  ^uJj(Mj-2Cj)u*j 

+uJj{W*j  -  -  ujjpsjsign^j)  -  uJjej 

+tr((W*j  -  W'jyrj'W'j) 

=  -uJjKpUtj  -  « Jp3j-sign(«*j)  -  uJjej 

<  -uJjKpUtj  -  p3j{\uij\  +  |«ij|)  +  ej(|«ij|  +  \u2j\) 

<  —uJjKpUxj  <  0 
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which  means  that  V  is  bounded.  So,  u*j  and  W*,-  are  bounded.  By  integrating  both  sides 
of  the  above  inequality,  it  can  be  shown  that  u*j  is  square-integrable.  Noting  that  u*j  is 
bounded,  by  Barbalat’s  lemma  u*j  converges  to  zero. 

•  Step  3  :  We  design  £1  j  and  xij  such  that  £+,-  and  xij  are  bounded  and  (7.30)  and 
(7.35)  are  satisfied.  In  the  control  law  (7.50),  rj*j  is  required,  which  means  that  (\3  and  X2j 
are  required  to  be  differentiable.  With  the  aid  of  the  results  in  [40],  we  design  ^  and  Xij 
(1  <  j  <  m )  as  follows. 


£y  = 

— Al£l  j  +  £2  j 

£2  j  = 

X  aj*(£2j  ■ 

-£27) 

-  Pij  sign 

7.SAT; 

Xij  = 

—P2X1  j  +  X2j 

X.2  j  = 

1 

M 

S' 

to 

^0. 

—  X2i) 

p2j  sign 

ieAT; 

I  ^  £2 i) 

VeA/7 


(  X  aji(X2j  ~  X2i) 


ieAT; 


where  (5\  and  are  positive  constants, 


£2,to+1  —  Ql,  771+1  +  iMl,m+l 

X2, 771+1  =  A  + 


(7.55) 

(7.56) 

(7.57) 

(7.58) 

(7.59) 

(7.60) 


and  pij  and  P22  are  chosen  such  that 


Plj(t)  >  l6,m+lWI 

P2j(t)  >  1X2,777+1^)1- 


(7.61) 

(7.62) 


For  the  systems  in  (7.56),  £2 j  exponentially  converges  to  £2,777+1  by  Lemma  7.6.  Equation 
(7.55)  can  be  written  as 

^(£ij  91,777+1)  =  /5i  (£1  j  91,777+1)  +  £2  j  £2,777+1- 

Since  fii  >  0,  £]_,-  exponentially  converges  to  9+m+i.  Similarly,  it  can  be  shown  that  Xij 
exponentially  converges  to  A.  Therefore,  conditions  1  and  2  in  Lemma  7.7  are  satisfied.  By 
Lemma  7.7,  q*j  converges  to  zero. 

With  the  above  controller  design  procedure,  we  have  the  following  results. 

Theorem  7.1.  Form  systems  in  (7.1)-(7.2)  and  a  leader  system  in  (7.3)-(7.f),  under 
Assumptions  7. 1-7. 2,  the  distributed  control  law  (7.50)  and  the  update  law  (7.53)  for  1  < 
j  <  m  ensure  that  (7.5)  holds  and  W*j  is  bounded,  where  rjij  and  rj2]  are  defined  in  (7.29) 
and  (7.33),  £1  j  and  X\j  are  generated  by  (7. 55)- (7. 58),  ki  (2  <  l  <  n)  are  chosen  such  that 
the  polynomial  in  (7.36)  is  Hurwitz,  p\3,  p2j ,  and  p3j  are  chosen  such  that  (7.61)-(7.62)  and 
(7.51)  are  satisfied,  aji  >  0,  fii  >  0,  (32  >  0,  Kp  and  Tj  are  positive  definite  matrices. 
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Remark  7.1.  In  the  proposed  control  laws,  the  neural  network  can  be  a  RBF  7ieural  network 
or  other  types  of  neural  networks.  In  short,  any  neural  network  works  in  this  paper  if  it  has 
the  approximation  property  in  (7-47).  For  a  specified  control  system,  one  can  choose  specified 
neural  networks  based  on  the  information  of  the  dynamics  of  the  system  for  convenience 
[107].  In  the  simulation  in  Section  7.5,  we  choose  a  RBF  neural  network  to  approximate  the 
unknown  function  fj  for  demonstration. 

Remark  7.2.  In  the  proposed  control  law  (7.50),  the  parameter  matrix  XV*j  in  the  neural 
network  is  tuned  online  by  the  algorithm  in  (7.53).  Therefore,  the  neural  network  does  not 
need  to  be  trained  off-line  in  advance.  This  is  one  of  the  advantages  of  the  proposed  control 
laws.  The  learning  algorithm  in  (7.53)  is  derived  with  the  aid  of  the  Lyapunov  function 
candidate  (7.54).  The  learning  algorithm  (7.53)  guarantees  that  W*3  is  bounded  but  does  not 
guarantee  that  XV* j  converges  to  its  optimal  value  W*j.  For  the  initial  value  ofXV*3,  one  may 
choose  them  to  be  any  bounded  values. 

Remark  7.3.  In  Theorem  7.1,  the  control  laws  are  distributed.  Only  neighbors’  information 
is  required  for  control.  To  deal  with  uncertainty  in  each  system,  neural  network  based  control 
laws  are  proposed  in  Theorem  7.1.  It  is  possible  to  propose  other  types  of  controllers  to  deal 
with  uncertainty,  for  example,  adaptive  control  laws,  robust  control  laws,  robust  adaptive 
control  laws,  etc.  For  space  limit,  we  omit  them  here. 

In  Theorem  7.1,  it  is  required  that  p3j  satisfies  (7.51).  However,  e,-  is  generally  unknown. 
To  meet  this  requirement,  p3j  can  be  chosen  to  be  a  large  number  or  p3j  is  estimated  on-line 
as  follows. 

P3j  =  M\uij\  +  \u2j\ )•  (7.63) 

To  verify  the  rightness  of  this  update  law,  we  choose  a  Lyapunov  function  candidate 

V  =  ifi JjMjU.,  +  ltr«W„  -  W.J)Trp(W.j  -  W.,))  +  i/jyt p3j  -  l ,)2. 

Differentiate  it  along  the  solution  of  the  closed-loop  system,  we  have 
V  =  —uJjKph^j  +  —  2Cj)u*j 

+uJj(W*j  -  W*j)T(f>j  -  ujjp3jsign(u*j)  -  ufjCj 

+tr((w*j:  -  ll',()  'iyir,()  +  fi^(p3j  -  €j)psj 

=  -uJjKpUtj  -  ujjp3jsign(u*j)  -  uj^j 
+p3]1(P3j  -  Zj)p3j 

<  f  uJjKpU^j  -  6j  (|«ij  |  +  \U2J  | )  -  uJjCj 

~i.P3j  -  D'Xl^ljl  +  l“2j|)  +  ^/(P3j  - 

<  —uJjKpU^j  <  0 

which  means  that  V  is  bounded.  So,  u*j,  fi3j ,  and  IT*-,  are  bounded.  By  integrating  both 
sides  of  the  above  inequality,  it  can  be  shown  that  u*j  is  square-integrable.  Noting  that  u*j 
is  bounded,  by  Barbalat’s  lemma  u*3  converges  to  zero. 

With  the  above  analysis,  we  have  the  following  results. 
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Theorem  7.2.  For  m  systems  in  (7.1)- (7.2)  and  a  leader  system  in  (7. 3)- (7.)),  under 
Assumptions  7. 1-7. 2,  the  distributed  control  law  (7.50)  and  the  update  law  (7.53)  for  1  < 
j  <  m  ensure  that  (7.5)  holds  and  W*j  and  p3j  are  bounded,  where  pij  and  r]2j  are  defined  in 
(7.29)  and  (7.33),  and  xij  are  generated  by  (7 .55)- (7 .58),  ki  (2  <  l  <  n)  are  chosen  such 
that  the  polynomial  in  (7.36)  is  Hurwitz,  pij  and  p2j  are  chosen  such  that  (7.61)-(7.62)  are 
satisfied,  p3j  is  updated  by  (7.63),  aji  >  0,  f3\  >  0,  f32  >  0,  fi3j  >  0,  Kp  and  Tj  are  positive 
definite  matrices. 

In  Theorem  7.2,  p^  and  p2j  are  required  to  satisfy  the  in-qualities  in  (7.61)-(7.62).  It  is 
possible  to  estimate  them  if  the  following  assumptions  are  satisfied. 

Assumption  7.3.  The  communication  graph  Q  is  bidirectional  and  node  (m  +  1)  is  globally 
reachable. 

Assumption  7.4.  £2,m+i  and  y2,m+i  are  bounded 

Under  Assumptions  7. 3-7. 4,  with  the  aid  of  Lemma  7.6  the  update  laws  for  p\3  and  p2j 
can  be  chosen  as 


Pij 


7 j 


5Z  (lJi  ( ^2 i) 


(7.64) 


hj 


7 j 


Y,  aji(X2j  -  X2i) 


(7.65) 


where  7 j  >  0  and  1  <  j  <  m.  These  results  are  summarized  as  follows. 

Theorem  7.3.  For  m  systems  in  (7.1)-(7.2)  and  a  leader  system  in  (7.3)-(7.f),  under 
Assumptions  7.2-7.f,  the  distributed  control  law  (7.50)  and  the  update  law  (7.53)  for  1  < 
j  <  m  ensure  that  (7.5)  holds  and  W*j  and  p3j  are  bounded,  where  rp j  and  p2j  are  defined 
in  (7.29)  and  (7.33),  (\3  and  xij  are  generated  by  (7.55)-(7.58),  ki  (2  <  l  <  n)  are  chosen 
such  that  the  polynomial  in  (7.36)  is  Hurwitz,  pij  and  p2j  are  updated  by  (7. 6 f)- (7. 65),  p3j 
is  updated  by  (7.63),  aj,  >  0,  fii  >  0,  f32  >  0,  fl3j  >  0,  7 j  >  0,  Kp  and  Tj  are  positive  definite 
matrices. 


7.4  Distributed  Tracking  Control  of  Multiple  Mechan¬ 
ical  Systems 

In  last  section,  we  solved  the  distributed  tracking  control  of  mechanical  systems  with  velocity 
constraints.  If  there  is  no  velocity  constraints,  the  method  proposed  in  the  last  section  also 
works. 

For  m  mechanical  systems,  the  dynamics  of  system  j  without  constraint  can  be  written 
as 


+  Cj(q*j,  q*j)q*j  +  Gj(q*j )  —  Tj 


(7.66) 
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where  q*j  =  [q^, . . .  ,qVij]T  is  the  state  of  system  j,  Mj(q*j)  G  Rnxn  is  a  bounded  positive- 
definite  symmetric  matrix,  Cj(q*j,  q*j)Gj  is  centripetal  and  Coriolis  torque,  Gj(q*j)  is  a 
gravitational  torque,  and  t3  e  Rr  is  the  control  input.  In  this  paper,  it  is  assumed  that  the 
dynamics  of  (7.66)  is  unknown  and  Property  7.2  is  satisfied.  The  communication  between 
systems  is  described  by  a  communication  digraph  Q . 

It  is  given  a  leader  system  whose  state  is  qm+i(t)  and  is  only  available  to  a  portion  of 
m  systems.  The  leader  system  is  labeled  as  system  m  +  1.  The  communication  between 
m  +  1  systems  is  described  by  the  communication  digraph  Qe .  The  distributed  tracking 
control  problem  is  to  design  a  distributed  tracking  control  law  for  each  system  using  its  local 
information  such  that  (7.5)  holds  for  1  <  j  <  m. 

The  control  laws  can  be  designed  by  following  the  procedure  in  the  last  section.  To  this 
end,  (7.66)  is  written  as 


q*j  =  u*j  (7.67) 

Mj(q*j)u*j  +  Cj{q*ji  q*j)u*j  +  Gj(q*j)  =  Tj  (7.68) 

where  Mj(q*j)  =  Mj(q*j),  Cj(q*j,  q*j)  =  Cj(q*j,  q*j)i  Gj(q*j)  =  Gj(q*j).  The  system  in 
(7.67)-(7.68)  has  a  cascade  structure.  Controllers  are  designed  in  three  steps. 

•  Step  1  :  For  system  (7.67),  the  distributed  controller  is  proposed  as 

u*j  =  r)*j  (7.69) 


where 


q*j  ^  )  Oji(<?*j  (l*t )  ~t~  Gj 

ieAT; 


(7.70) 


and  Gj  is  an  estimate  of  q*,m+ i  and  will  be  designed  later  such  that 

lim  (Gj  —  Q*,m+i)  e—  0.  (7.71) 

t—t  oo 

By  Lemma  7.6,  it  can  be  shown  that  (7.5)  holds  with  the  control  input  (7.69). 

•  Step  2  :  Since  u*j  is  not  the  real  control  input,  u^j  cannot  be  rj*j.  Let  Gj  =  u*j  —  r] '*,• 
and  q*j  —  Q*j  ~  Q*,m+ i,  then 

q*j  'y  )  Uji ( q*j  q*i)  T  u*j  T  Gj  q*,m+ 1  (7.72) 

ieAr; 

( q^j )  Cj(q*j,  q*j )  Tj  ( 4  (q*j )  f/  *  j  T  Gj  ( q*j ,  q*jGl*j  T  G  j(q*j))  •  (7.73) 

It  can  be  shown  that  system  (7.72)  has  the  ISS  property  with  input  Gj  +Gj  ~  Q*,m+ 1-  Next, 
we  design  Tj  such  that  Gj  converges  to  zero.  Since  dynamics  (7.66)  is  unknown,  fj(xj) 
defined  in  (7.46)  is  unknown.  We  choose  a  suitable  activation  function  and  suitable  weights 
and  thresholds  in  the  hidden  layer,  then  fj(xj)  can  be  written  as  (7.47).  We  propose  the 
control  law  as  in  (7.50)  and  the  update  law  as  in  (7.53).  Similarly,  it  can  be  proved  that  Gj 
converges  to  zero  and  W*j  is  bounded. 
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•  Step  3:  In  this  step,  we  design  such  that  is  bounded  and  (7.71)  is  satisfied. 
This  step  is  similar  as  Step  3  in  the  last  section.  The  control  law  for  is  proposed  as 


'  1  i  •./  T  C *j 

(  \ 

E  aji(C*j  ~  C*i) 

VeA/ 7  / 

(7.74) 

C *j  y  (  Ojjiifi^j  C*i)  Pij  sign 

ieAT; 

(7.75) 

where 

C*,m+1  9*,m+ 1  PlQ*,m-\-l 

(7.76) 

and 

Pij  F  \J C*,m+lC*,m-\-l- 

(7.77) 

With  the  above  controller  design  procedure,  we  have  the  following  results. 

Theorem  7.4.  For  m  systems  in  (7.66)  and  a  leader  system  with  state  q*:m+i, 

under  As- 

sumption  7.1,  the  distributed  control  law  (7.50)  and  the  update  law  (7.53)  for  1  <  j  <  m 
ensure  that  (7.5)  holds  and  W*j  is  bounded,  where  rjtJ  is  defined  in  (7.70),  is  generated 
by  (7.7 f)-(7.75),  pij  and  p3j  are  chosen  such  that  (7.77)  and  (7.51)  are  satisfied,  aji  >  0, 
/3\  >  0,  /?2  >  0,  Kp  and  Tj  are  positive  definite  definite  matrices. 

In  Theorem  7.4,  it  is  required  that  p3j  satisfies  (7.51).  It  is  possible  to  estimate  p 3j  as  in 
the  following  theorem. 

Theorem  7.5.  For  m  systems  in  (7.66)  and  a  leader  system  with  the  state  q*,m+i,  under 
Assumption  7.1,  the  distributed  control  law  (7.50)  and  the  update  law  (7.53)  for  1  <  j  <  m 
ensure  that  (7.5)  holds  and  W*j  and  p3j  are  bounded,  where  rj*j  is  defined  in  (7.70),  £*j  is 
generated  by  (7.7 4)- (7.75),  p\j  is  chosen  such  that  (7.77)  is  satisfied,  p3j  is  updated  by 

n 

P3j  =  P3jj2\uij\  (7-78) 

i=  1 

aji  >  0,  (3i  >  0,  fi3j  >  0,  Kp  and  T_,-  are  positive  definite  matrices. 

In  Theorem  7.5,  py  is  required  to  satisfy  the  inequalities  in  (7.77).  It  is  possible  to 
estimate  them  under  the  following  assumption. 

Assumption  7.5.  and  q*,m+  i  are  bounded. 

Theorem  7.6.  For  m  systems  in  (7.66)  and  a  leader  system  with  the  state  q*,m+i,  under 
Assumptions  7.3  and  7.5,  the  distributed  control  law  (7.50)  and  the  update  law  (7.53)  for 
1  <  j  <  m  ensure  that  (7.5)  holds  and  W*j  and  p3j  are  bounded,  where  rj*j  is  defined  in 
(7.70),  is  generated  by  (7. 7 f)- (7. 75),  p\j  is  updated  by 


Pij 


n 


7,Z 


'y  ]  aji(Cij  Cn) 
ieA/7 


(7.79) 


p3j  is  updated  by  (7.78),  aji  >  0,  /3\  >  0,  fi3 j  >  0,  7 j  >  0,  Kp  and  T^  are  positive  definite 
matrices. 
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Figure  7.2:  Configuration  of  a  wheeled  mobile  robot 


7.5  Simulations 


7.5.1  Formation  control  of  Multiple  Mobile  Robots 

To  verify  the  proposed  results  in  Section  7.3,  simulation  has  been  done  for  formation  control 
of  five  nonholonomic  wheeled  mobile  robots  on  a  horizontal  plane  (Fig.  7.2).  For  robot  j , 
its  dynamics  and  the  constraints  are  shown  in  (7.1)-(7.2),  where  q*j  =  [xj,  i/j,  0j}T ,  J(q*j)  = 
[sin^j,  cos^j,  0],  Mj  =  diag [m j,  rrij,  Ij],  Cj  =  0,  Gj  =  0, 


1 

Rj 


cos  6j  cos  6j 
sin  Qj  sin  9j 
Lj  ~  Lj  _ 


(. Xj,yj )  is  the  position  of  robot  j,  9j  is  the  orientation  of  robot  j,  Rj  is  the  radius  of  the 
driving  wheels,  2 Lj  is  the  distance  between  the  two  driving  wheels,  rrij  is  the  mass  of  robot 
j,  and  Ij  is  the  inertia  moment  of  robot  j  around  the  vertical  axis.  In  the  controller  design, 
the  dynamics  of  each  robot  is  assumed  to  be  unknown  for  controller  design. 

It  is  given  a  leader  system  (7.3)-(7.4)  and  a  desired  formation  defined  by  a  geometric 
pattern  V  whose  vertexes  are  at  coordinate:  (pxi,Py\),  ( Px2,Py2 ),  ( Px3,Py3 ),  ( Px4,Py4 ),  and 
( PxbiPyb )•  The  leader  system  is  labeled  as  system  6.  The  formation  control  problem  of  five 
mobile  robots  is  to  design  distributed  control  laws  Tj  using  neighbors’  information  such  that 


lim 

i 

H 

1 

1 _ 

= 

Pix 

Pxj 

£—>•00 

_  Vi  -  Vj 

Piy 

~~  Pyj 

lim  ( 9j  —  9q)  =  0, 1  <  j  <  5 


£—>•00 


&  (Ey^e]  =0, 


£—>•00 


I E  yf  -  »> )  =  o- 


The  velocity  constraint  (7.2)  is  equivalent  to 

ij  =  Wij  cos  9j,  ijj  =  W\j  sin  9V  9j  =  w2j 


(7.80) 

(7.81) 

(7.82) 

(7.83) 

(7.84) 
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Vb  = 
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T 


(7.88) 


where  W\3  and  w2j  are  the  speed  and  angular  speed  of  robot  j.  The  formation  control  problem 
can  be  solved  with  the  aid  of  the  results  proposed  in  the  last  section.  To  this  end,  we  define 

3  = 

<?2 j  =  {xj  -  pxj)  cos  Oj  +  (yj  -  pyj )  sin  Oj 
<  q3j  =  (xj  -  pxj )  sin  Oj  -  (yj  -  pyj)  cos  Oj  (7.85) 

U\j  W2  j 

.  U2j  =  Wlj  ~  W2jQ3j 

for  1  <  j  <  6,  where  px6  =  py6  =  0.  Then, 

<?ij  =  uij,  q2j  =  u2j,  (-i3j  =  uijq-2j  (7.86) 

which  is  a  special  case  of  system  (7.27).  In  dynamics  (7.25), 

111.jq3.iq3j  0 

riijCti]  0  ’ 


Mj  = 


m3q23j  +  Ij  mjq3j 


m](l3] 


m a 


Bj 


<13  i+Lj  q3j—Lj 
Rj  Rj 

1  1 


,  Gj  =  0. 


In  (7.85),  the  notation  ql3  is  reused  in  conformity  to  the  notation  in  Section  7.3.  It  can 
be  shown  that  the  formation  control  problem  is  solved  if  (7.5)  is  satisfied  for  1  <  j  <  5. 
Therefore,  the  proposed  distributed  control  laws  in  Section  7.3  can  solve  the  formation  control 
problem. 

In  the  simulation,  it  is  assumed  that  the  desired  formation  pattern  is  shown  in  Fig.  7.3 
and  the  state  of  the  leader  system  is  (. x6,y6,06 )  =  (10sin(0.5f),  — 10 cos(0.5f),  0.5f).  The 
distributed  control  laws  in  Theorem  7.1  solve  the  formation  control  problem.  In  the  control 
laws,  we  choose  the  activation  function 


cpj(z) 


=  e 


-z2/ 2 


(7.87) 


and  ?/h  is  defined  in  (7.88).  4>j  can  be  chosen  as  other  forms  which  are  omitted  here  for  space 
limit.  Fig.  7.4  shows  the  communication  digraph  between  systems.  Figs.  7.5-7.7  show  the 
response  of  (xj  —  x§  —  pXj),  (yj  —  ye  —  Pyj),  and  (Oj  —  0q)  for  1  <  j  <  5,  respectively.  The 
simulation  results  show  that  (7.5)  is  satisfied.  Fig.  7.8  shows  the  centroid  of  Xi  (1  <  i  <  5) 
(be.,  Ej=i Xj/h)  and  xq.  Fig.  7.9  shows  the  centroid  of  y%  (1  <  i  <  5)  (i.e.,  Y^=iUj/ 5)  and 
y6.  Fig.  7.10  shows  the  path  of  the  centroid  of  the  five  robots  and  its  desired  path.  Fig.  7.11 
shows  the  estimates  of  the  parameter  W*j  in  the  neural  networks.  The  simulation  results 
verify  that  (7.81)-(7.83)  are  satisfied.  Eqn.  (7.80)  is  also  verified  and  the  response  of  them 
is  omitted  here.  The  results  in  Theorem  7. 2-7. 3  were  also  validated  by  simulations.  Due  to 
space  limitation,  we  omit  them. 
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x  (m) 


Figure  7.3:  Geometric  pattern  of  the  formation 


Figure  7.5:  Response  of  {xj  —  x6  —  pXj )  for  1  <  i  <  5. 
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Figure  7.6:  Response  of  (tjj  —  yG  —  pyj)  for  1  <  i  <  5. 


Figure  7.7:  Response  of  [6j  —  #6)  for  1  <  i  <  5. 


Figure  7.8:  Response  of  the  centroid  of  Xi  (solid)  for  1  <  i  <  5  and  xe  (dashed). 


Figure  7.9:  Response  of  the  centroid  of  y,-  (solid)  for  1  <  i  <  5  and  y 6  (dashed). 


Figure  7.10:  The  path  of  the  centroid  of  the  five  robots  (dashed  line),  the  desired  path  (solid 
line)  of  the  centroid  of  robots,  and  formation  of  the  five  robots  at  several  moments  (red 
pentagons). 


Figure  7.11:  Estimates  of  parameter  W*j  in  neural  networks. 
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(7.89) 


7.5.2  Synchronization  of  Multiple  2-DOF  Manipulators 

To  verify  the  proposed  results,  simulation  has  been  done  for  three  follower  systems  and  one 
leader  system.  For  the  three  follower  systems,  each  system  is  planar  manipulator  with  two 
revolute  joints  (see  [115]).  The  dynamics  of  each  system  can  be  written  as  (7.66),  where 
Qj  G  R2  is  the  joint  variable,  r3  is  the  control  input, 

dn  d\2 

d\2  d'22 

hq2j  h(qij  +  q2j) 

—hqij  0 

(rriilci  +  m2li)g  cos  q\3  +  m2lc2g  cos(gij  +  q2j) 
rn2lc2  cos((/,j  +  q2j) 

=  mil2i  +  m2(l 2  +  l2 2  +  2Rl22 
+21 1 lc2  cos  q2j)  +  I\  +  I2 
=  m2(l2c2  +  hlc2  cos  q2j)  +  I2 
=  m2l22  + 12 
=  -m2lilc2smq2j 

where  the  physical  meaning  of  each  variable  above  can  be  found  in  [115].  For  simplicity, 
three  follower  systems  are  assumed  to  be  identical.  The  communication  between  systems  is 
defined  by  the  digraph  in  Fig.  7.12.  The  state  of  the  leader  system  is  g* 4  =  [2  cost,  3  sin2f]T 
and  is  available  to  system  1.  The  distributed  control  problem  is  to  design  distributed  control 
law  for  each  system  such  that  (q*j  —  g*4)  converges  to  zero. 

In  the  simulation,  the  dynamics  is  unknown.  By  Theorem  7.5,  the  control  law  is  (7.50) 
and  the  update  law  is  (7.53).  In  the  control  law,  the  activation  function  is  chosen  as  in  (7.87) 
where  'tpj  is  defined  in  (7.89).  Fig.  7.13  shows  the  time  response  of  (qy,-  —  qu)  for  1  <  j  <  3. 
Fig.  7.14  shows  the  time  response  of  ( q2j  —  q24 )  for  1  <  j  <  3.  It  is  shown  that  (q*j  —  q*4) 
converges  to  zero,  which  means  that  the  proposed  results  in  Theorem  7.5  are  right.  The 
simulation  of  the  control  laws  in  Theorem  7.6  has  also  been  done.  The  simulation  results 
verify  the  results  in  Theorem  7.6.  Due  to  space  limitation,  we  omit  them  here. 

7.6  Conclusion 

This  chapter  considers  distributed  leader- following  cooperative  control  of  uncertain  mechan¬ 
ical  systems  with/without  velocity  constraints.  Neural  network  based  distributed  control 
laws  are  proposed  with  the  aid  of  distributed  estimation,  robust  control,  and  neural  network 
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Figure  7.12:  Communication  digraph. 


Figure  7.13:  Response  of  {q\j  —  qi±)  for  1  <  j  <  3 


Figure  7.14:  Response  of  (q-2j  —  924)  for  1  <  j  <  3 
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approximation  techniques.  Applications  of  the  proposed  results  are  presented.  Simulation 
results  show  the  effectiveness  of  the  proposed  results. 
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Chapter  8 


Distributed  Formation  Tracking 
Control  of  Multiple  Mobile  Robotic 
Systems 

8.1  Introduction 

Consensus  problem  for  multi-agent  systems  has  been  intensively  studied  due  to  developments 
of  distributed  computing  and  graph  theory, 

Robotic  mobile  vehicle  systems  are  applied  into  variety  of  environments  including  mili¬ 
tary  and  industry  with  advantages  of  high  flexibility  and  various  capabilities,  when  equipped 
with  accessories  such  as  hand  grippers  and  infrared  detector,  mobile  vehicles  can  fulfil  com¬ 
plex  tasks  of  rescue, security  and  navigation.  Cooperation  of  multiple  vehicles  receive  more 
attentions  in  recent  years  as  group  performances  guarantee  higher  efficiency  and  robustness, 
compared  with  monolithic  system,  multivehicle  systems  are  more  applicable  to  spatially  dis¬ 
tributed  environments  where  mobile  vehicles  are  required  to  function  in  different  locations, 
disability  of  a  portion  of  vehicles  won’t  affect  the  overall  performance  by  simply  being  cut  off 
from  the  rest  sound  ones.  Before  developing  capabilities  for  multivehicle  systems,  it  is  im¬ 
portant  to  study  the  coordination  problem  since  individual  vehicle  in  the  group  is  expected 
to  move  in  specific  manners,  various  control  methods  are  applied  to  formation  control  of 
multivehicle  systems  and  rendezvous  problem.  Coordination  of  multivehicle  systems  can  be 
transformed  into  consensus  problem  as  all  vehicle  systems  are  supposed  to  converge  to  a 
reference  state,  from  analysis  of  vehicle  models,  it  is  known  kinematic  of  vehicle  systems 
is  a  first-order  nonlinear  system,  by  linearization  from  state  transform  or  other  nonlinear 
control  methods,  vehicle  kinematic  system  can  be  stablized  and  converge  to  consensus  val¬ 
ues.  Consensus  on  multiple  single-integrator  systems  is  addressed  in  [29,33,34,45].  In  [34], 
Consensus  control  for  both  continuous-time  and  discrete  single-integrator  is  addressed,  the 
authors  consider  switching  communication  graphs  and  the  conception  of  union  of  digraph 
is  introduced  to  solve  the  consensus  for  dynamically  changing  topology.  Consensus  control 
algorithms  for  multiple  second-order  systems  are  studied  in  [116]  [117].  In  [117],  Tracking 
with  a  time-varying  second-order  leader  is  addressed,  leader  of  both  bounded  acceleration 
and  linear  form  are  considered.  In  [118],  Consensus  problem  for  multiple  high-order  linear 
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systems  with  time  delays  in  both  the  communication  network  and  inputs  is  considered,  ob¬ 
server  based  output  feedback  protocols  are  proposed  for  arbitrarily  large  yet  bounded  delays. 
In  [119],  The  authors  use  decentralized  discrete-time  block  control  scheme  to  achieve  forma¬ 
tion  and  trajectory  tracking,  both  first-order  and  second-order  systems  are  discussed,  each 
agent  is  provided  with  discrete-time  state  observers  and  formation  tracking  can  be  achieved 
applying  the  proposed  block  control  with  a  consensus  scheme.  In  [120],  distributed  consensus 
tracking  algorithms  without  velocity  measurements  under  both  xed  and  switching  network 
topologies  for  first-order  and  second-order  kinematics  for  proposed  for  a  leader- follower  com¬ 
munication  topology.  A  mild  connectivity  requirement  is  adopted  for  distributed  consensus 
tracking  and  swarm  tracking. 

Formation  tracking  is  one  common  problem  of  multiple  vehicle  coordination,  a  time- 
varying  reference  signal  is  regarded  as  the  desired  trajectory  and  all  the  vehicle  agents  are 
supposed  to  track  it.  unlike  centralized  formation  tracking  control,  in  which  individual 
follower  can  utilize  information  from  reference  signals  directly  along  with  its  own  states,  dis¬ 
tributed  formation  tracking  control  utilizes  information  of  vehicle’s  own  states  and  that  from 
its  neighbors  from  which  it  can  receive  information  from  wireless  communication.  In  general 
communication  topologies,  only  a  portion  of  vehicles  can  communicate  with  the  reference 
signal,  control  of  all  the  other  vehicles  depends  on  control  information  from  their  neighbors. 
Distributed  formation  control  is  addressed  in  [121]  [122]  [123]  [6],  in  [121],  a  new  kinematics 
model  for  leader- follower  system  is  addressed  and  globally  stable  controller  is  designed  with 
the  aid  of  backstepping  methods.  In  [122]  [123],  Formation  stabilization  for  multiple  nonholo- 
nomic  mobile  robots  is  addressed  and  distributed  control  methods  are  studied  for  vehicles 
kinematic  systems  with  the  aid  of  cascaded  system,  a  leader- follower  graph  is  applied  to 
describe  the  communication  topology  of  multivehicle  systems.  In  [6],  Distributed  formation 
tracking  methods  are  addressed  with  the  aid  of  a  process  by  suitable  variable  transformation. 
Delayed  communication  is  considered  for  the  proposed  controllers.  In  [124],  a  novel  forma¬ 
tion  control  technique  of  multiple  wheeled  mobile  robots  employing  artificial  potential  field 
based  navigation  is  addressed  ,  the  communication  graph  is  considered  as  a  leader-follower 
topology,  the  leader  motion  by  artificial  field  and  followers  motion  by  control.  In  [125], 
Instead  of  measuring  the  poses  directly  from  sensors,  the  authors  apply  continuous-time  ex¬ 
tended  Kalman  filter  to  estimate  the  poses  under  the  assumption  each  robot  has  only  coarse 
positioning  sensors.  In  [126],  he  leader- waypoint-follower  formation  is  constructed  based  on 
relative  motion  states,  the  followers  are  designed  to  move  to  their  desired  waypoints,  both 
stable  tracking  and  receding  horizon  tracking  control  methods  are  applied  to  guarantee  the 
convergence  errors  stable  and  tend  toward  zero  efficiently.  In  [127],  a  formation  controller 
is  designed  to  make  the  formation  control  system  robust  against  the  unmeasured  velocity  of 
the  leader  robot  with  the  Lyapunov  redesign  technique. 

In  real-life  operations,  control  of  kinematics  is  not  practical  due  to  the  unavailability  of 
velocities,  engine-generated  torques  actually  control  the  motion  of  vehicles.  From  analysis 
of  vehicle  dynamics.  It  is  learned  parametrical  uncertainties  exist  in  the  dynamic  systems. 
Uncertainties  are  either  estimated  by  adaptive  control  methods  [128]  [129]  or  through  neural 
networks’  on-line  training  process  [130]  [131].  In  [128]  [129],  Parametrical  uncertainties  are 
estimated  by  adaptive  control  methods  and  a  dynamics-based  controller  is  designed  with  the 
aid  of  kinematic-based  controller  and  backstepping  methods.  In  [130]  [131],  Neural  networks 
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are  applied  to  estimate  the  dynamics  of  the  robots  and  computed-torque  controller  is  designed 
with  the  aid  of  kinematic-based  formation  controller  and  backstepping  methods.  In  [132], 
A  dynamics-based  controller  consisting  of  a  feedback  linearization  part  and  a  sliding  mode 
compensator,  is  designed  for  leader-tracking. 

In  this  chapter,  distributed  formation  tracking  of  multiple  wheeled  unicycles  is  considered, 
variable  transformations  are  utilized  to  change  vehicle’  kinematic  system  into  chained-form 
system,  exponential  stability  of  cascaded  system  is  introduced  for  controlling  distributed 
formation  tracking  algorithms  for  transformed  kinematic  systems  and  exponential  stability 
of  the  chained-form  systems  is  proved  to  guarantee  all  vehicles  track  the  desired  reference 
trajectory  with  fixed  formation.  Distributed  controller  for  vehicles’  dynamics  is  designed 
with  the  aid  of  backstepping  methods  and  kinematics-based  controller,  sliding  mode  control 
method  is  applied  to  estimate  the  parametrical  uncertainties.  Compared  with  the  distributed 
algorithms  in  [133],  the  control  methods  proposed  in  this  paper  is  more  practical  and  im- 
plementable  since  the  derivatives  in  kinematic  control  part  is  removed,  besides,  the  variable 
transformation  and  control  laws  are  conciser  compared  with  that  in  [133],  which  also  sim¬ 
plifies  the  control  in  real-life  operations.  Simulations  have  been  done  to  prove  the  proposed 
control  algorithms. 


8.2  Problem  Statement 


With  the  aid  of  Lagrange-D’Alembert  principle,  m  unicycle  systems  with  three  generalized 
states  are  defined  as 


ddj f  q*j ) q*j  Cj ,  q*j ) q*j  A  G  j ( q*j )  -^j(,q*j')x j  A  J  (q*j ) Aj  (A .  1  ]) 

J(q*j)q*j  =  0  (8.2) 

where  q*j  =  [qij,  qgq  q3j]T  =  [xj,l/j,  OjV  are  the  states  of  system  j,  Mj(q^j)  is  a  3  x  3  positive- 
definite  symmetric  matrix,  Cj(q*j,  q*j)q*j  represents  centripetal  and  Coriolis  force,  Gj(q*j) 
is  the  gravitational  force,  Bj(q^j)  is  a  3  x  2  input  transformation  matrix,  J(q*j)  is  the  two- 
dimensional  control  inputs  vector,  A  j  is  the  constraint  force  imposed  on  system  j.  Then 
derivatives  of  generalized  states  q^j  can  be  defined  as 


q*j  a(q*j)v*j 


cos  9j  o 
sin  6j  0 
0  1 


Ui 


(8.3) 


In  the  right  hand  of  (8.1)  there  are  nonholonomic  constraints  JT (q*j)Xj  which  have  noth¬ 
ing  to  do  with  controlling  torques,  notice  g(q*j )  *  JT (q*j)  =  0,  then  by  replacing  q ^  in  (8.1) 
with  V*j,  nonholonomic  constraints  are  removed. 

Mj(q*j)V*j  A  Cj(q*j,  q*j)V*j  A  Gj(q*j)  =  Bj(q^j)Tj  (8-4) 


where 


Mj(q*j)  =  gT(q*j)Mj(q*j)g(q*j ) 
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Cj(q*j,  Q*j)  =  9T(q*j)Mj(q*j)g(q*j) 

+gT  (q*j)Cj(q*j ,  q*j)g{q*j) 

Bj (q*j)  g  ( q*j ) Bj (q*j) 

The  communication  between  vehicles  is  characterized  by  a  directed  tree  G  =  (V,  £) 
through  this  paper,  where  V  is  the  set  of  vehicle  vertices  with  V  =  {vi,  v2, vm}  and 
£  eV  x  V.  eVJ  =  (uj,  t>j)  is  an  element  of  £  if  the  state  information  flow  goes  from  v%  to  v3 
,  Vi  is  called  a  neighbor  of  Vj  and  A fj  represents  the  sets  of  all  neighbors  of  v3 .  For  the  m 
mobile  vehicle  systems,  adjacency  matrix  A  =  [dji]  is  given  to  characterize  edge  set  £  with 
dji  =  dij  >  0  and  da  =  0  since  individual  vehicle  doesn’t  need  communication  to  receive  its 
own  states.  Laplacian  matrix  £  =  [LJt]  of  the  graph  Q  with  adjacency  matrix  A  is  defined 
as 

—dji,  if  i  G  A fj  and  i  ^  j 

0,  if  i  Afj  and  i  ^  j 

Y,  ajh  if  J  =  i- 

The  time-varying  reference  signal  is  defined  by  a  sinsudal  trajectory 


Xq  =  v0  cos  90 
Vo  =  v0  sin  d0 

0o  =  (8.5) 


where  the  subscript  0  means  the  reference  signal  is  regarded  as  a  virtual  vehicle  agent, 
the  desired  formation  of  multivehicle  systems  is  denoted  by  V  with  a  group  of  orthogonal 
coordinates  p3  =  ( PjX,Pjy )  f°r  (1  <  ]  <  m ),  p3  satisfy  jyjLiPjx  —  0  and  Y^jLiPjy  —  0. 
Po  =  ( Pox,Poy )  f°r  the  virtual  leader  is  supposed  to  be  (0,0). 

Distributed  formation  tracking  control  is  defined  as  designing  control  laws  VMJ  =  [v3,  uj3] 
for  system  j  by  using  its  own  state  information  and  its  neighbors’  state  information  such 
that 


lim 

0C  2  X j 

_ 

Pix 

Pjx 

t—}  OO 

_  Vi  -  Vj  _ 

Piy 

~  Pjy 

lim  (6i  -  90)  =  0 


lim 

t—}  OO 


E 

,i=i 


Xi 


m 


x0 


0,  lim 

t—>  OO 


E 

L/=l 


m 

m 


Vo 


0 


(8.6) 

(8.7) 

(8.8) 


for  1  <  i  7^  j  <  m. 

It  is  known  that  Eqn.  (8.6)  guarantees  vehicles  keep  formation  V  during  the  motion. 
Eqn.  (8.7)  vehicles  reach  the  consensus  orientation.  Eqn.  (8.8)  ensures  the  centriod  of 
multivehicle  system  converges  to  the  virtual  leader. 

Define  the  states  transformation  equations  as 

'  ql3  =  03 

<?2j  =  {xj  -  pjx )  cos  93  +  (y3  -  pjy)  sin  93 
'  <l3j  =  (xj  -  Pjx )  sin  93  -  (y3  -  pjy)  cos  93  (8.9) 

vl3  =  u3 

.  V2 j  =  vj  -  Vljq3 j 
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Then  the  transformed  state  space  is 


4i 3 

=  Dj 

(8.10) 

<?2  j 

=  D  j 

(8,11) 

Qsj 

=  ^23 

(8.12) 

The  virtual  leader  in  (8.5)  is  also  transformed  to  the  chained-form  system  in  (8.10)-(8.12) 
by  (8.9)  as 


<?io  =  Do 
<l20  =  Do 

<?30  =  D0<?20 


Lemma  8.1.  //lim^0O(gli  -  q10)  =  0,  limt^00(q2J  -  q20)  =  0,  and  limf^00(g3j  -  g30)  =  0  for 
1  <  j  <  m,  then  (8.6)-(8.8)  hold. 


Proof:  by  qij  =  9j  in  (8.9),  (8.7)  holds,  by  definitions  of  q2j  and  q3j  in  (8.9)  it  follows 

that 


therefore, 


Xj 

Pjx 

cos  0j  sin  9j 

Q2j 

Vj 

~  Pjy 

sin  9j  —  cos  9j 

.  . 

lim 

i 

1 

■o> 

1 _ 

=  lim 

cos  9j  sin  9j 

92  j 

t->-oo 

Sr 

1 

rs 

f— >•  oo 

w 

B 

1 

o 

o 

w 

v? 

.  ^3  j  _ 

cos  90  sin  90 

920 

sin  90  —  cos  90 

930 

^0  POx 
Vo  -  Poy 


linit-Kx, [a??  -  Pjx  -  %o,  Vj  -  Pjy  -  Vo]  =  [o,  0],  then  (8.6)-(8.8)  hold.  ■ 

Define  q¥J  =  [qij,q2j,q3j\,  by  Lemma  8.1,  the  control  problem  can  be  transformed  to 
designing  control  laws  v*j  =  V\v  v2j  such  that 


lim  (q*j  -  g*0)  =  0 


(8.13) 


with  the  its  own  states  information  and  that  from  its  neighbors. 
Notice 


V*j  =  B]v*j 


where  B  = 


1  0 

-3  j  1 

Substitute  V*j  in 


(8.14)  into  (8.4),  we  have 

Mj(q*j)v*j  +  Cj(q*j,  q*j)vi,j  +  Gj(q*j)  =  Bj(q*j)rj 


(8.14) 


(8.15) 
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where 


Mj  ( ({.j )  =  Bj  Mj  (q.j )  Bj 
Cj{q*ji  Q*j)  =  Bj  Mj(q*j)Bj  +  Bj  Cj(q*j,  q*j)Bj 

—  Bj  Bj(q*j) 

Eqn.  (8.15)  has  the  following  properties 

Property  1:  Matrix  Mj  —  2 Cj  is  skew-symmetric. 

Property  2:  For  any  differentiable  vector  v  G  R3,  we  have 

flfj  {q*j)  b*j  P  B'j {q*j-,  q*j)v*j  -f*  G j ( q *j )  1  j (ll*j ■  ) *j •  i  Pj ) 

where  a,j  is  an  inertia  parameter  vector  of  mass  and  moment  of  inertia,  Y)(g*j,  q*j,  v^j,  v*j)  is 
a  known  function  of  q*j,  q*j,  v*j  and  v*j.  dj  is  supposed  to  be  unknown. 

by  (8.15)  it  is  known  t3  are  the  real  control  inputs,  we  hrst  propose  a  control  law  of  v*j 
for  (8.10),  then  we  design  control  laws  of  Tj  with  the  knowledge  of  backstepping  method. 


8.3  Main  Results 

Before  designing  distributed  formation  tracking  control  of  multivehicle  systems,  we  introduce 
a  theorem  of  exponential  stability  of  cascaded  system,  consider  the  cascaded  system 

x\  =  /i(t,xi)  P  g(t,x1,x2)x2 

x2  =  f2{t,x2)  (8.16) 

where  x\  G  7 Zn,  x2  G  lZn,fi(t,xi)  is  continuously  differentiable  in  (t,x i),  g(t,x\,x2)  and 
f2(t,x2)  are  locally  Lipschitz  in  (xi,x2)  and  x2. 

Theorem  8.1.  (8.16)  is  globally  exponential  stable  if  it  satisfies  the  following  three  assump¬ 
tions  [134] [135]. 

Assumption  8.1.  :h\  =  fi(t,xi)  is  globally  exponential  stable  and  there  exists  a  continuously 
differentiable  function  V(t,x i)  :  1Z+  x  lZn  which  satisfies 

h\\x i\\a  <  V(t,x i)  <  A;2||a;i||a 

dV  dV 

where  ki,k2,  k3  and  a  are  positive  numbers. 

Assumption  8.2.  the  interconnection  function  g(t,  x±,  x2)  satisfies  for  all  to  >  0 

I \g(t,  xux2)\\  <  0i(||x2||)  +  02{\\X‘i\\)x1 
where  6\  and  02  are  continuous  functions. 
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Assumption  8.3.  x2  =  2)  is  globally  exponentially  stable  and  for  allt0  >  0,  it  follows 

that  _ 

poo 

/  \\f2(to,t,X2(to))\\  <  fc(||x2(to)||) 

Jt0 

where  k  is  a  class  K,  function. 


Consider  a  linear  time- varying  system 


-  o  •••  • 

.  O' 

'  1  ' 

o  • 

.  0 

0 

X  = 

0  : 

:  :  0 

x  + 

0  : 

:  :  0 

0  : 

:  <j>(t)  0  _ 

.  0  . 

where  <f>(t )  is  a  bounded  continuously  differentiable  Lipschitz  function. 
Lemma  8.2.  The  control  algorithm 

u  =  —k2Xi  —  k3(p{t)x  2  —  k±x3  —  k5cp(t)x  4  —  ... 
ensures  system  (8.17)  is  globally  exponentially  stable  if  ki  are  such  that 

Xn  +  kx  A”-1  +  ...  +  kn 


is  Hurwitz  [13f]. 


(8.17) 


(8.18) 


8.4  Distributed  Controller  for  Kinematic  Systems 

The  following  assumption  is  made  on  the  leader  agent. 

Assumption  8.4.  The  (0  <  i  <  2)  are  bounded  and  f(+T  v*0(r)dT  >  a  for  some  a  >  0 
and  T  >  0. 

Assumption  8.4  means  signal  v*o  is  persistently  excited  signal  (PE  signal). 

Theorem  8.2.  For  m  systems  in  (8.10)-(8.12),  if  a  directed  spanning  tree  exists  in  the 
directed  communication  graph  with  the  virtual  leader  the  root  of  the  tree,  then  the  distributed 
control  laws 

vij  =  uij  =  -  aji(qij  -  Qu)  -  aj,m+i{qij  -  qio)  +  Sij  (8.19) 

Mj 

b\j  f  d \j)  Uym+i  {d\j  hio) 

i&Mj 

-pisign[  aji(dij  -  <5u)  -  ~  (ho)]  (8.20) 

*eA fj 

for  1  <  j  <  m,  hio  =  uiq,  guarantee  that  q\3  globally  exponentially  converge  to  q±o- 
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Proof:  Define  S\3  =  Si3  —  <510,  (8.20)  can  be  written  as 

6ij  f  )  Oiji(5\j  $li)  U-j.m+l  5  lj 

ieJVj 

-pisign  Y1  ajSij  -  5n)  -  ~  <5io  (8.21) 

ieMj 

Define  5i*  =  [<5^,  , ...,  8mj\,  with  the  aid  of  Laplacian  matrix  (8.21)  can  be  written  as 

<fi*  =  — (£  +  B)5i*  —  pisign  (£  +  .B)<5i*  —  <5iol  (8.22) 

where  C  is  Laplacian  matrix  of  the  communication  diagraph,  B  =  diag(aijm+i,  a2>m+i, ...,  amim+i) 
is  the  diagonal  matrix  representing  communication  with  the  virtual  leader,  from  the  charac¬ 
teristics  of  £  it  is  known  the  directed  spanning  tree  guarantees  £  +  B  is  positive  symmetric 
with  eigenvalues  in  the  right  half  of  the  complex  plane  [136].  Choose  Lyapunov  function 
Vi  =  where  <5i*  =  [<5n,  ...,<Sim],  and  differentiate  it  along  (8.22),  it  follows  that 

Vi  =  +  B)8i*  —  <5y[pisign  (£  +  B)Su  —  (^Aol 

=  -5f*(£  +  B)6U  -  pi  sign  (£  +  B)SU 

—  ((£  +  B)6u)t(L  +  B)  ^iqI 
Let  a  be  the  minimum  eigenvalue  of  (£  +  B)~l ,  then 

V  <  -Sl(£  +  B)SU  ~  api$Tsign  [(£  +  B)SU]  -  ®T(L  +  B)-1^  1 
where  $  =  ((£  +  B)Su).  It  can  be  proved  if  pi  satisfies 

^  ||(£  +  5)_1||||(51ol|| 

Pi  > - 

a 

then  V]  <  — <5,*  (£  +  B)5u,  let  7  be  the  smallest  eigenvalue  of  £  +  B,  we  have 

Ci  <  -~8l(£  +  B)~8 u<-'y621  =  ^-xV1 

0.5 

V\  <  2^V\ 

which  means  V\  is  globally  exponentially  stable  then  globally  exponentially  converge  to 

<W 

Substitute  v\3  in  (8.19)  into  (8.10)  we  have 

Qij  'y  ]  (tji i/lij  Qii)  (dlij  ?io)  "L  y 1  j  (8.23) 

i&Mj 

define  ql3  =  ql3  —  qw,  (8.23)  can  be  written  as 

Qij  ) )  Ujif-l i j  Qii)  ®j,m+ 1 Q\j  d-  (8.24) 

ieMj 


110 


similarly  like  (8.22),  (8.24)  can  be  written  as 


Qu  —  ~~  +  B)qi*  +  <5i*  (8.25) 

since  8\  is  globally  exponentially  stable,  it  can  be  proved  q3j  globally  exponentially  converge 
to  q10.  ■ 


Theorem  8.3.  For  m  systems  in  (8.10)-(8.12),  if  a  directed  spanning  tree  exists  in  the 
directed  communication  graph  with  the  virtual  leader  the  root  of  the  tree,  then  the  distributed 
control  laws 


v2j  =  u2j  =  ~k2q2j  ~  hu^q-ij  +  52j  (8.26) 

<%  =  —  aji(^ j  ~  ^2 i)  ~  0>j,m+l(^2j  ~  ^2o) 

iGAfj 


~p2  sign 


&ji(d2j  —  d2 i)  —  Oj,m+l(^2j  —  ^20 ) 

ieJVj 


(8.27) 


for  1  <  j  <  m,  S2 o  =  u20  +  k2q20  +  k3Ui0q30,  guarantee  that  q2j  globally  exponentially  converge 
to  q2 o  and  q3j  globally  exponentially  converge  to  q30. 

Proof:  substitute  v2j  in  (8.26)  into  (8.11),  it  follows  that 


q2j  —  —k2q2j  —  k3U\jq3j  +  S2j 


(8.28) 


Define  (*j  =  [Cip  C2 j]  as 

Clj  =  5Z  aji(d2j  —  Q2i)  —  aj,m+l(q2j  ~  920  ) 

C2 j  y  ]  93 i)  0,j,m+l{Q3j  930  ) 

ieMj 


differentiate  along  (8.28)  and  (8.12)  we  have 

Cij  =  aji[(~k2q2j  -  k3uijq3j  +  S2j)  -  {-k2q2i  -  k3uuq3i  +  S2i)] 

ieMj 

~aj,m+i[(~k2q2j  —  k3Uijq3j  +  S2j)  —  ( —k2q2o  —  k3U\oq3o  +  $20)] 

=  —k2(ij  —  k3uiof2j  +  ^2  aji($2j  —  d2 i)  —  aj>m+i(d2j  —  S2o) 

-k3[  J2  aji{{uij  -  uw)q3j  -  (uu  -  u10)q3i )  -  aj)m+l{uij  -  u10)q3j\  (8.29) 

*e  Nj 

C2  j  ^  )  Uji  (Uj  lj  92 j  U\ i,q2i)  a  j  \jQ2j  ^  1 0920 ) 

iGAfj 

—  uwCi j  +  [  F  aji((uij  ~  uw )q2j  —  (uu  —  Uio)q2i)  —  aj>m+i(uij  —  U\o)q2j]  (8.30) 

i£Afj 
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define  82j  —  <%  ~  820,  Ui j  =  Ui j  —  uuh  then  (8.29)  and  (8.30)  can  be  written  as 

Cl?  =  — ^2Cl j  "  ^3MloC2 j  +  X/  aji(82j  —  821)  —  %,m+1^2j 

ieAfj 

^''3  [  )  [  Uji  («  lj  9'.\j  U ljQ3i )  Qij,m+l'U,ljQ3j\ 

i&Mj 

C2 j  loClj  4"  [  )  [  Uji (ll 1  j  </2j  U\ jQ2i)  ajtm+lUljq2j] 

i&Mj 

notice  82j  and  8\j  have  the  same  structure,  by  (8.21)  we  have 

82)  ^  [  QJjii82j  82i)  1  82j 

*eA fj 


/ysigl  1  'y  [  (Ijj  ( 82  j  8  2i)  @/j,m-t-l82j)  8 


Dehne 

X1  =  [[Cm  C21],  [Cl2,  C22],  •••,  [Clm,  C2m]]T 
X2  =  [[<521,  oil,  <5ll],  •••,  [82m,  Ql mi  5lm]]T 
by  (8.31)  and  (8.32)  we  have 


fii  = 


-k2  -k3uw 
uw  0 


=  [f  11,...  Jim. 


X) i&Mj  ®i*(^2j  821)  Clj,m.+l82j 

9j  ^3  [X)igA/”j  Q'jiJljQSj  8hjQ3i)  Q‘j,m+l'U‘ljQ3j\ 

^2i£j\fj  dji  J\j92j  <1  1j'<72/)  Q'j,m+l^'ljQ2j 

g(t,x i,x2)x2  =  [gi,g2,  ...,gm] 
by  (8.33),  (8.24)  and  (8.21)  we  have 

XagA/}  ®ji(82j  <^2* )  CLj,m+l82j 

P2Slgn  ®ji{82j  82i)  Oj,m+1^2j) 

—  ^20 

f2j  ®7*(0lj  Qli)  Q,j,m+lQlj  4”  8\j 

XagA/}  <5li)  ®y»n+l<5lj 

Pi  sign  X)igA/j  @ji(8lj  <5li)  Q?‘,m+l<5ij) 

— 1 <5l0 

f2(t,X2)  =  [/21,  /22j  /2m] 


(8.31) 

(8.32) 


(8.33) 
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Consider  (8.17),  the  closed-loop  states  equation  by  substituting  u  in  (8.18)  is 

'  -k2  -k3<j>(t)  -kA  ■  ■■  0 

<j>(t)  0  .  0 

x  =  0  =  =  :0  a;  (8.34) 

o  ;  ;  ;  o 

o  ;  ;  (p(t )  o . 

notice  the  second  order  matrix  fy  is  special  case  of  (8.34),  since  wio  is  continuous  PE  signal, 
then  by  Lemma  8.2,  X\  =  fi(t,Xi)  is  globally  exponentially  stable,  then  the  Assumption 
1  in  Theorem  8.1  holds,  gj  can  be  proved  to  satisfy  Assumption  2  in  Theorem  8.1  and 
from  the  expression  of  f2j  it  can  be  proved  x2  =  /2 (t,  x2)  is  globally  exponentially  stable  and 
Assumption  3  holds,  therefore,  X\  =  [[Cn,  C21],  [C12,  C22],  •••,  [Cim,  (2m}}  is  globally  exponentially 
stable.  From  the  definition  of  Cij  and  (2j, 

Ci j  —  aji(cl2j  ~~  Q2 i)  ~  aj,m+i(Q2j  —  Q20) 

ieMj 

^  (  ®'ji(,Q2j  Q2 i)  Q'j,m-\-lQ2j 

ieMj 

Ci*  =  (^  +  b)q2* 

since  Ci*  is  globally  exponentially  stable,  then  g2*  =  (£  +  5)^1C  1*  is  exponentially  stable  and 
q2j  globally  exponentially  converge  to  q2 0,  similarly,  we  can  prove  q%j  globally  exponentially 
converge  to  ^30-  ■ 

Theorem  8.4.  For  m  systems  in  (8.10)-(8.12),  if  a  directed  spanning  tree  exists  in  the 
directed  communication  graph  with  the  virtual  leader  the  root  of  the  tree,  then  the  distributed 
control  laws  (8.19)-(8.20)  and  (8.26)- (8.27)  guarantee  (8. 6) -(8. 8)  hold. 

Proof:  By  Theorem  8.2  q\j  globally  exponentially  converge  to  q\o.  By  Theorem  8.3  q2j 
globally  exponentially  converge  to  q2 0,  q^j  globally  exponentially  converge  to  q30.  By  Lemma 
8.1  (8.6)-(8.8)  hold.  ■ 

8.5  Distributed  controller  for  dynamics 

In  previous  section,  distributed  formation  tracking  laws  are  proposed  for  vehicles’  kinematics, 
however,  from  the  dynamics  in  (8.15)  it  is  known  the  real  control  inputs  are  torques  generated 
by  vehicle  engines,  in  this  section,  distributed  control  algorithms  are  proposed  with  the  aid 
of  backstepping  methods  and  sliding  mode  control. 

Define  v*j  =  v*j  —  u*j,  where  v*j  =  [v\j,v2f],  u*j  =  [u±j,u2j],  we  have 

Theorem  8.5.  For  m  systems  in  (8.10)-(8.12),  if  a  directed  spanning  tree  exists  in  the 
directed  communication  graph  with  the  virtual  leader  the  root  of  the  tree,  then  the  distributed 
control  laws 

Tj  =  +  CjU*j  +  Gj  —  kv*j  —  Yj/3sign(Y^v^j))  (8.35) 

where  k  satisfies  ||a  —  a||  <  k,  and  (8. 19) -(8. 20), (8. 26) -(8. 27)  guarantee  (8.6)-(8.8)  hold. 
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Proof:  Denote  the  inertia  parameter  error  vector  a  =  a  —  a,  choose  Lyapunov  function 
V2  =  ^vJjMjV*j,  differentiate  V2  it  follows  that 

V2  =  Y  (8.36) 

substitute  (8.35)  into  (8.15)  we  have 

Mji^j  +  CjV*j  +  Gj  =  +  CjU*j  Y  G:j  -  kv ^  -  Yjf3sign{Yj'v*j) 

—  ii*j)  +  Cj(v*j  —  u*j)  =  —kv*j  Y  Yjd  +  Yj/3sign(Y^v*j) 

MjV*j  =  -Cjv*j  -  ki)*j  Y  Yjd  +  Yjf3sign{Yj'v*j)  (8.37) 

substitute  Mjd*j  into  (8.36)  it  follows  that 
1 

V2  =  -vJjMjV^j  Y  vfj^—CjV^j  -  kv*j  Y  Yjd  Y  Yjf3sign(Yj' v^)) 

=  ^ vJj(Mj  -  Cj)v*j  -  vjjkv^j  +  i’JjYjd  -  vJjYj/3sign(Y^ v*j) 

1 

<  2^5 _  ~  v*jkv*j 

since  Mj  —  Cj )  is  skew-symmetric,  V2  <  —vjjkv*j,  let  \m  be  the  maximum  eigenvalue  of 
Mj  then  V2  <  ~ylV2,  then  v*j  are  exponentially  stable  and  v*j  —  u*j  globally  exponentially 
converge  to  zero. 

(8.19)  and  (8.26)  are  rewritten  as 

Vlj  'y  djiid lj  Ql i)  ®j,m+ 1  9lo) 

i&Mj 

+5\j  Y  Vij  (8.38) 

v2j  =  - k2q2j  -  kzUijqij  Y  S2j  Y  v2j  (8.39) 

C*j  =  [Cij>  Qij\  are  the  same  as  dehned  in  Section  8.3,  it  follows  that 

Clj  ^'2  C 1  j  ^3^1,m+lC2j 

Y  y  )  Clji  ( S2j  &2i)  (1j.rn+ 1  S2j 

Nj 

Y  y  )  0>ji(fd2j  U2f)  0>j,m+VU,2j 

ietfj 


^3  [  y  ,  U-ji  (  a  \jd‘3j  a  |  j 1 

(8.40) 

iGAfj 

Qlj  ~  ~  X/  aji(9lj  ~  Qli)  ~  aj,m+lQlj  Y  Sij  +  U2j 

(8.41) 

iGAfj 


C2 j,  Si j  and  52j  are  unchanged  as  expressed  in  (8.32),  (8.21)  and  (8.33). 


9j 


®ji(^2j  S2f)  0'j,rn+\S2j 

0Jji{fjj2j  d 2j. )  Cjjn  \  1  4.2) 

dji:  (a  I  jd'ijt  a  1  j  Q3i ) 

C  p  (  (I  \jd2j  U  I  j  d2  i )  U  jjn  -\  1  U  ljQ2j 
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g(t,x i,x2)x2  =  [gi,g-2,  -,gm] 

X/igA/j  ^2i)  dj,m+L^2j 

— P2Slgn  aji($2j  ~  &2i)  ~  0>j,m+1^2j) 

~  $20 

f2j  =  —  X^gA/j-  aji{Qlj  ~~  Ql i)  —  aj,m+lQlj  +  $lj  +  Ui j 

X^igA/j  ®ji(^lj  ^1?)  Qj,m+l^lj 

Pi  Sign  XbeA'",  ^li) 

— <^io 

fij  are  the  same  as  that  in  Section  8.3,  it  can  be  proved  that  the  modified  cascaded  system 

xi  =  fi(t,xi)  +  g(t,x1,x2)x2 
%2  =  f2(t,x2) 

still  satisfies  the  Assumptions  in  Theorem  8.1  and  q*j  =  [qij ,  q2j ,  Q3j\  exponentially  converge 
to  g*0  =  [910,920,930],  by  Lemma  8.1,  (8.6)-(8.8)  hold.  ■ 

8.6  distributed  controller  for  time- varying  communi¬ 
cation  topology 

In  real-life  operations,  due  to  disconnection  or  creation  of  links  and  nodes  failures,  the 
communication  topology  is  time-varying,  it  has  been  proved  through  a  infinite  sequence  of 
nonoverlapping,  uniformly  bounded  time  interval,  if  the  union  of  the  graphs  across  each 
interval  has  a  directed  spanning  tree,  then  multi-agent  systems  reach  consensus  with  the  aid 
of  theories  of  SIA  matrices  [34] . 

Theorem  8.6.  For  m  systems  in  (8.10)-(8.12),  if  at  any  nonoverlapping,  uniformly  bounded 
time  interval,  a  directed  spanning  tree  exists  for  union  of  the  graphs  across  the  interval,  with 
the  virtual  leader  the  root  of  the  spanning  tree,  then  the  distributed  control  laws  (8.19)- 
(8.20) ,(8.26) -(8. 27)  and  (8.35)  guarantee  (8.6)-(8.8)  hold. 

8.7  Simulation  Results 

To  show  the  effectiveness  of  the  proposed  results,  simulation  has  been  done  for  four  robots. 
The  desired  geometric  pattern  V  is  shown  in  Fig.  8.1  ,  assume  the  format  of  the  robot 
systems  is  in  square  shape.  The  pattern  V  can  be  described  by  orthogonal  coordinates 
(Pix,Piy)  =  (0,1),  (p2x,P2y)  =  (-1,0),  ( Pzx,Pzy )  =  (0,-1)  and  (pax,Pav)  =  (1,0).  For  the 
leading  agent,  assume  the  reference  trajectory  is  (£5,  y$,  6-f)  =  (10sin(f),  —  10cos(f),  t)  and 
(P5x,P5y)  =  (0,  0),  v5  =  10  and  uj5  =  1. 

Fig.  8.2  represents  the  communication  graph  for  the  multivehicle  systems,  pi,  p2,  k2 
and  P3  are  assigned  2,  k  in  dynamic  control  laws  is  10.  Fig.  8.4  shows  the  centroid  of  Xj 
(1  <  j  <  4)  (i.e.,  J2j=ixj/ 4)  and  x0.  Fig.  8.5  shows  the  centroid  of  yj  (1  <  j  <  4)  (i.e., 
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X^=iJ/j/4)  and  |/o-  Fig.  8.6  shows  ( 6j—90 )  (1  <  j  <  4).  Fig.  8.7  shows  the  formation  tracking 
of  the  4  followers,  the  blue  spots  represent  each  follower  robot,  the  black  spot  represent  the 
trajectory  of  centroid  of  the  robots. 

Assume  the  information  communication  graph  switches  according  to  the  following  logic. 


£ 


Q  in  Fig.  8.2,  if  t  —  round (t)  >  0 
Q  in  Fig.  8.3,  if  t  —  round  (t)  <  0 


For  the  switching  topologies  defined  above,  Fig.  8.8  shows  the  centroid  of  Xj  (1  <  i  <  4) 
and  Xq.  Fig.  8.9  shows  the  centroid  of  i/j  (1  <  j  <  4)  and  y0.  Fig.  8.10  shows  (03  —  90 ) 
(1  <  j  <  4).  Fig.  8.11  shows  the  formation  tracking  of  the  4  followers. 
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Figure  8.1:  Desired  geometric  for-  Figure  8.2:  Information  exchange  Figure  8.3:  Information  ex- 
mation.  graph  Q.  change  graph  Q. 


Figure  8.4:  Response  of  the 
centroid  of  Xj  for  1  <  j  <  4 
and  xq. 


x(m) 


Figure  8.5:  Response  of  the 
centroid  of  y3  for  1  <  j  <  4 
and  yQ. 


Figure  8.6:  Response 
of  ( 9j  —  0o )  for  1  <  j  < 
4. 


Figure  8.7:  formation  track¬ 
ing  of  4  followers. 


Figure  8.8:  Response  of  the  Figure  8.9:  Response  of  the 
centroid  of  Xj  for  1  <  j  <  4  centroid  of  yj  for  1  <  j  <  4 
and  Xq.  and  po- 


4> 


x(m) 


Figure  8.10:  Response  r^.  t  .. 

°  figure  8.11:  formation 

°  (  3  o)  or  1  <  j  <  tracking  of  4  followers. 
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Chapter  9 

Distributed  Exponentially  Tracking 
Control  of  Multiple  Wheeled  Mobile 
Robots 

9.1  Introduction 

The  coordination  of  multi-agent  systems  has  been  studied  intensively  in  recent  years  be¬ 
cause  of  its  wide  use  in  large  object  moving,  cooperative  target  pursuit,  rescue  mission, 
etc.  The  configurations  of  multi-agent  systems  determine  it  can  perform  with  less  time  and 
achieve  higher  accuracy  in  mapping  [137,138].  For  multi-agent  systems,  a  leader/follower 
architecture  is  usually  defined  with  the  follower  agents  following  the  trajectory  of  the  leader 
agent  [139-141],  Different  control  schemes  have  been  proposed  to  reach  the  consensus.  Co¬ 
operative  control  schemes  have  received  considerable  attention  due  to  the  development  of 
network  consensus  theory.  It  removes  the  unstableness  of  communication  networks  with 
centralized  controlling  leader  agent,  which  can  be  disturbed  with  connection  breakage,  with 
more  connections  requiring  more  network  bandwidth  capacities.  Distributed  control  schemes 
can  reduce  the  cost  of  broadband  connection  by  offering  connection  with  the  leader  agent 
to  only  a  small  part  of  follower  systems.  In  [142-144],  consensus  algorithms  are  proposed 
for  linearized  systems  with  the  aids  of  graph  theory,  where  each  agent  is  considered  a  vertex 
in  the  communication  graph,  the  communication  pattern  is  characterized  with  a  Laplacian 
matrix,  and  the  consensus  goal  is  achieved  with  the  aid  of  the  characteristics  of  communi¬ 
cation  graph.  In  [142],  the  authors  consider  directed  communication  networks  with  fixed 
and  switching  topologies  and  also  undirected  networks.  Consensus  protocols  are  proposed. 
In  [145],  distributed  flocking  algorithms  are  proposed  for  free-spaee  and  obstacle  avoidance 
cases.  In  [146],  the  authors  consider  a  weaker  condition  of  spanning  tree  structure.  In  [147], 
the  Vicsek  model  is  studied  and  convergence  results  are  derived.  In  [148],  a  distributed 
control  strategy  for  connectivity  preserving  swarm  aggregation  with  collision  avoidance  is 
presented.  In  [149],  a  feedback  control  strategy  is  proposed  for  convergence  of  a  multi-agent 
system  to  a  desired  formation  configuration.  The  cases  of  agents  with  single  integrator  and 
nonholonomic  unicycle-type  kinematics  are  both  studied.  Formation  infeasibility  is  consid¬ 
ered  and  related  with  the  flocking  behavior  by  proving  the  convergence  of  velocity  values.  In 
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[150],  the  authors  consider  consensus  algorithms  for  double- integrator  dynamics  for  bounded 
control  inputs  with  connected  communication  graph  and  other  cases.  States  consensus  is 
proved  under  different  communication  patterns.  In  [151],  the  consensus  problem  of  a  group 
of  autonomous  agents  with  an  active  leader  is  studied.  A  distributed  feedback  law  along  with 
a  distributed  state-estimation  rule  is  proposed  for  each  continuous-time  dynamical  agent. 
The  Lyapunov-based  convergence  analysis  is  given  for  the  multi-agent  system  considered 
with  a  varying  interconnection  topology. 

In  realities,  the  state  information  of  the  leader  agent  is  not  available  to  all  the  follower 
systems,  especially  when  the  networks  are  very  large.  In  [152],  the  Lyapunov  techniques  are 
combined  with  the  graph  theory  and  distributed  control  laws  are  proposed  for  convergence 
of  a  desired  pattern.  In  [153] ,  the  authors  analyze  consensus  algorithms  with  a  time- varying 
reference  state  by  using  theoretical  graph  tools.  The  information  flow  in  [153]  is  not  what 
is  usually  considered  from  the  leader  to  the  followers  and  thus  increase  the  robustness  of 
the  whole  systems.  In  [154],  an  adaptive  controller  design  method  is  proposed  such  that 
each  agent  reconstructs  the  reference  velocity  and  recovers  the  desired  formation.  For  the 
time-varying  reference  velocity  case,  a  controller  redesign  is  presented  and  the  parameter 
convergence  is  guaranteed.  In  [155],  decentralized  cooperative  controllers  are  proposed  with 
backstepping  techniques.  In  [156],  the  distributed  formation  control  problem  for  multiple 
nonholonomic  robots  is  considered  and  consensus  algorithms  are  proposed  with  the  aid  of 
graph  and  Lyapunov  theories. 

In  this  chapter,  we  consider  multiple  wheeled  mobile  robots  with  nonholonomic  con¬ 
straints  and  analyze  the  distributed  control  schemes  such  that  the  robots  converge  to  the 
desired  formation  whose  centroid  moves  along  the  trajectory  of  a  leader  robot.  In  order  to 
propose  distributed  controllers,  first  a  variable  transformation  is  introduced  to  change  state 
models  into  chained  systems.  Then  we  propose  a  new  state  model  and  design  the  control 
laws  for  the  new  states  in  order  to  reach  the  control  goals.  In  this  paper,  the  dynamic  models 
of  wheel  robots  is  taken  into  consideration.  We  directly  design  control  laws  for  the  torques 
imposed  on  wheels  in  reality  instead  of  the  velocities  of  robots.  The  simulation  results  show 
the  effectiveness  of  our  distributed  cooperative  control  strategies  for  the  dynamics  models  of 
leader-follower  systems. 

9.2  Problem  Statement 

Considering  m  simplified  car-like  robots  with  three  states.  We  can  define  the  m  robot  systems 
with  dynamical  models  by  Lagrange-D’Alcmbert  principle 

+  Cj(q*j,  q*j)q*j  +  Gj(q*j)  =  Bj(yq*j)rj  +  J  ( q*j)\j  (9-1) 

J(q*j)<i*j  =  o  (9.2) 

where  =  [qXv  q2j ,  q-sj]T  =  [xj,  yj ,  9j]T  are  the  states  of  system  j,  Mj(q*j)  is  a  3  x  3  positive- 
definite  symmetric  matrix,  Cj(q*j,  q*j)q*j  represents  centripetal  and  Coriolis  force,  Gj(q*j) 
is  the  gravitational  force,  Bj(q*j)  is  a  3  x  2  input  transformation  matrix,  J(q*j)  is  the  two- 
dimensional  control  inputs  vector,  Xj  is  the  constraint  force  imposed  on  system  j.  By  (9.2), 
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can  be  defined  as 


Q*j  d(Q*j)V*j 


cos  9j  0 
sin  9j  0 
0  1 


Uj 


Eqn.  (9.1)  has  the  following  two  properties  for  the  dynamic  models. 
Property  1:  Matrix  Mj  —  2Cj  is  skew-symmetric. 

Property  2:  For  any  differentiable  vector  <5  G  i?3,  we  have 


( q*j ) 4  T  Cj  (q*j  1 q*j ) 4  "t"  G3  ( q *j )  1)  ( q *j  ,  q*j .  4,  S ) Oj 


(9.3) 


where  dj  is  an  inertia  parameter  vector  which  is  related  with  the  mass  and  moment  of  inertia, 
Yj(q*j,q*j,6,6)  is  a  known  function  of  q*j ,  q*3 ,  5  and  5.  dj  is  supposed  to  be  unknown. 

Suppose  each  robot  can  acquire  state  information  from  some  of  the  other  systems.  This 
information  communication  can  be  defined  in  a  communication  digraph  G  =  (V,  £)  where 

V  is  the  set  of  nodes  for  the  directed  graph  with  V  =  {vi,v2,  ...,vm}  and  £  is  the  subset  of 

V  x  V.  For  system  i  and  j,  eij  =  ( Vi ,  v3)  belongs  to  £  if  the  state  information  of  system  i  can 
be  received  by  j  and  i  is  called  a  neighbor  of  robot  j.  Mj  represents  the  sets  of  all  neighbors 
of  robot  j.  In  this  paper,  we  assume  that  the  communication  graph  is  directed. 

For  the  m  robot  systems,  the  communication  graph  is  Q  =  (V,  £).  If  is  given  an  m  x  m 
constant  matrix  A  =  [ ]  with  =  atj  >  0,  the  Laplacian  matrix  £  =  [L3i]  of  the  graph  Q 
with  weight  matrix  A  can  be  defined  by 

o, 

ajh 

V  is  defined  as  formation  of  the  m  robots,  this  geometric  pattern  can  be  described  by  a  group 
of  orthogonal  coordinates  ( PjxiVjy )  (1  <  j  <  m)  which  satisfy  M'jLiPjx  =  0  and  MjLiPjy  =  0. 
The  trajectory  of  the  leader  agent  is  described  by  q0  =  ( x0,yo,90 )  which  satisfies 

x0  =  v0  cos  6»0,  y 0  =  v0  sin  90  ,  90  =  uj0  (9.4) 


if  i  G  Mj  and  i  ^  j 
if  i  Mj  and  i  ^  j 

if  j  =  i. 


where  v0  and  u0  are  known  functions  and  state  q0  is  assumed  to  be  available  to  only  one 
robot  in  this  paper.  The  control  problem  can  be  described  as  designing  control  laws  Vj  and 
Uj  for  system  j  using  its  own  state  information  and  its  neighbors’  state  information  such 
that 


lim 

OC  ^  j 

_ 

Pix 

Pjx 

£— >•  oo 

_  Vi  -  Vj  _ 

Piy 

~  Pjy 

lim  (9,  -9 0)  =  0 


lim 

£—>•00 


'  m 

Ej^i 

- Xo 

i  I m 


0,  lim 

£— >•  OO 


V-  Vi 

M - Vo 

Mim 


0 


(9.5) 

(9.6) 

(9.7) 


for  1  <  i  7^  j  <  m. 
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In  the  control  problem,  Eqn.  (9.5)  guarantees  all  the  agents  converge  to  the  formation 
V.  Eqn.  (9.6)  ensures  that  the  orientation  of  each  robot  converges  to  the  orientation  of  the 
leader  robot.  Eqn.  (9.7)  means  that  the  centriod  of  the  group  of  robots  converges  to  the 
trajectory  of  the  leader  robot. 

Define  the  change  of  variables 

= 

-2 j  =  (Xj  -  pjx)  cos  6j  +  (yj  -  pjy)  sin  03 
<  z3 j  =  (xj  -  Pjx )  sin  9j  -  (y3  -  pjy)  cos  03  (9.8) 

Vlj  =  Uj 

.  v2j  =  Vj  -  Vljz3j 

Then  the  transformed  state  space  is 

zy  =  vljt  z2j  =  v2j,  z3j  =  vijz2j  (9.9) 

The  leader  agent  in  (9.4)  can  also  be  transformed  to  the  model  above  by  (9.8)  as 


ZlO  —  Vio,  Z2o  —  V20,  Z3q  —  VijZ20 . 

Lemma  9.1.  //limt^00(^iJ-  -  z10)  =  0,  lirn^o 0(z2j  **  z20)  =  0,  and  lim^^zsj  -  z30)  =  0  for 
1  <  j  <  m,  then  (9.5)-(9.7)  hold. 

The  proof  is  omitted  due  to  limitation  of  space. 

By  Lemma  9.1,  the  control  problem  is  to  design  control  laws  V\3  and  v2]  such  that 

lim  (z*j  -  z* 0)  =  0  (9.10) 

t— >  oo 

where  z*3  =  [zij,z2j,z3j\  and  z* o  =  [^10,^20,^30],  with  the  its  own  and  neighbors’  state 
information. 

In  order  to  remove  the  constraint  component  JT (cpj)\3  and  transform  the  states  in  (9.1) 
into  v*j  =  [v\3l  v2j\,  similar  transform  is  implemented  as  in  [157],  it  follows  that 

T/j  f-Pj)  9*j  T  Cj  ,  Q*j  )v%j  T  Gj  ( (j  )  Id  j  ((j*j)  t  j  (9.11) 

Notice  Tj  are  the  real  control  inputs,  we  first  propose  a  control  law  of  v*3  for  (9.9),  then  we 
design  control  laws  of  t3  with  the  knowledge  of  backstepping  method. 

9.3  Distributed  Controller  Design 

The  following  assumption  is  made  on  the  leader  agent. 

Assumption  9.1.  The  (0  <  %  <  2)  are  bounded  arid  jf+T  u(0(r)cir  >  a  for  some  a  >  0 
and  T  >  0. 

Assumption  9.1  means  that  signal  V\q  is  persistently  excited  signal  (PE  signal).  For  a 
PE  signal,  we  have  the  following  result. 
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Lemma  9.2.  For  the  system 


5  = -fa  (t)25  +  ^2(t)  (9-12) 

where  ifi  (t)  is  a  PE  signal,  if  if2  (t)  is  bounded  and  converges  to  zero,  then  5  converges  to 
zero. 

In  order  to  design  the  controllers,  variable  transformation  is  introduced  as 

s%j  (9.13) 

where  *  means  1  to  3.,  &ij  =  cr3j  =  0,  cr2j  =  — /c3VijS3j,  and  &3  >  0.  Then  Eqn.  (9.9)  can  be 
transformed  into 


j  ~  vij 

S2j  —  V2j  +  k^VijSzj  +  SsjVij ) 
s3 j  —  —kzv\jS$j  +  VijS2j. 

Then  we  can  have  the  following  lemma. 

Lemma  9.3.  For  the  transformed  systems  in  (9.14)-(9.16)  if 

lirn  (sij  -  si0)  =  0,  linr  (vij  -  u10)  =  0 

for  1  <  i  <  3,  then  (9.10)  hold.  The  proof  is  omitted  here  due  to  space  limits. 
Lemma  9.4.  For  the  m  systems  in  (9.1f)-(9.16),  under  Assumption  1,  if 

lim  (s2j  -  s20 )  =  0,  lim  (vXj  -  vw)  =  0 


then 

(hm  (Ssj  -  sx)  =  0 


(9.14) 

(9.15) 

(9.16) 

(9.17) 

(9.18) 

(9.19) 


Proof:  Let  s3j  =  s3j  —  s30,  then 

§3j  =  —k^vljSsj  +  k^{v\Q  —  vlj)s3Q  +  V\jS2j  —  ViqS2o  (9.20) 

Since  hnij^00(i'lj  —  v10)  =  0,  vXj  is  a  bounded  PE  signal.  Since  lim^00(s,2J  —  s20)  =  0, 
VijS2j  —  Uios20  converges  to  zero.  By  Lemma  9.2,  (9.19)  holds.  ■ 

By  Lemma  9.4,  if  we  design  control  laws  to  make  linit_>.00(sij  —  sio)  =  0,  limt_>.0O(i;ij  — 
U10)  =  0,  and  limt_).0O(s2j  —  s2o)  =  0,  then  (9.10)  holds. 

Lemma  9.5.  For  the  m  systems  in  (9.1f)-(9.16),  if  the  communication  graph  is  connected 
and  the  state  of  the  leader  is  available  to  one  of  the  m  follower  systems,  the  control  laws 

Vij  —  Aj  —  —oiiSij  +  Ci  j  (9-21) 

Cij  y  ]  Cl*)  C10) 

ieAfj 

Pi  sign  aii(Cij  -  Cn)  +  bjPj((ij  -  C10)  (9.22) 
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for  1  <  j  <  m  guarantee  that  limt_>.0O(sij  —  si0)  =  0  and  lim^oo  (vij  —  i>i0)  =  0,  where 


jij 


1,  if  leader  agent  state  is  avaible  to  system  j 
0,  otherwise 


aq  >  0,  bj  >  0,  Cio  =  iho  +  ctiSio,  and  pi  is  a  sufficiently  large  constant. 

Proof:  Eqn.  (9.22)  can  be  redefined  with  the  knowledge  of  Laplacian  matrix  as 


Ci*  ~  —  £Ci*  —  Pi  sign(£Ci*  +  B{ Ci*  —  lCio))  —  B( Ci*  —  lCio)  (9.23) 

where  Ci*  =  [Cm  •  •  • ,  Cim]T  and  B  =  diag[&i/ii, . . . ,  bmpm] .  Let  Cij  =  Cij  ~  Cio,  then  Eqn. 
(9.23)  can  be  transformed  into 


Ci*  ~  —  (■£  +  B) Ci*  —  p\  sign((£  +  B) Ci*)  —  Ciol-  (9.24) 

where  Ci*  =  [Cn,  •  •  • ,  Cim]T-  We  choose  Lypapunov  function  F  =  YfjL i  §Cip  and  differentiate 
F  along  (9.24),  then  we  have 

F  =  -Cl(C  +  B) Cl*  -  C7*P1  sign((£  +  B)Cu)  -  :£,Ci0l 
=  -Cl(C  +  B) Cl*  -  Ci>i  sign((£  +  B) Cl*) 

—  ((£  +  i?)Ci*)T((£  +  5)t)  1Ciol 

Let  Ci  be  minimum  eigenvalue  of  ((£  +  i?)T)_1,  then 

F  <  -tl(C  +  B) Ci*  -  CiPi  {{C  +  S)Ci*)Tsign((£  +  B)( u) 

~  ({£  +  B)(u)T  ((£  +  B)T)  1Ciol 

Since  C  +  B  is  symmetric  and  positive  definite,  if 

,  ^  ||((£  +  B)T)-1IIKiol 
Pl~ - Z - ’ 

it  can  be  verified  F  <  —  C[C(£  +  B) Ci*.  Therefore,  lim^oo Cij  =  0  which  means  that  Cij 
converges  to  Cio-  Let  Vi  —  where  Sy  =  S\3  —  s10,  differentiate  V\  along  (9.14),  we  have 

V\  =  —q;i s\j  +  SijCij  <  —  2aqVi  +  \(lj\^/2V1 

Define  Vi  =  \fV[,  then  Vi  <  — aqV^  +  ^75 1  Cij  I  -  It  can  be  proved  that  limt_>.0O(sij  —  sio)  =  0. 
By  (9.21), 

lim  (vij  -  v10)  =  lim  (-aqsij  +  Cij  -  Do) 

t—>  OO  t — ^OO 

=  Um  (-aisij  +  uio  +  aisio  -  uio) 

=  —  lim  ai(s\j  —  sio)  =  0. 
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Lemma  9.6.  For  the  m  systems  in  (9.1f)-(9.16),  if  the  communication  graph  is  connected 
and  the  state  of  the  leader  is  available  to  one  of  the  m  follower  systems,  control  inputs 

v2j  —  ?2 j  —  —  X]  aji(S2j  —  S2i)  —  bjHj(s2j  —  S2o)  — 
ieMj 


P2  sign 


aji(s2j 

i&Mj 


S2i)  +  bjPj(s2j  ~  S20 ) 


-k3(vljS3j  +  S3jVlj) 


(9.25) 


for  1  <  j  <  m  guarantee  that  lim^00(s2j  —  s20)  =  0,  where  p2  is  a  sufficiently  large  constant. 
Proof:  Substitute  v2j  into  (9.15) 

■s2*  =  —Cs2*  —  -B(s2*  —  s2ol)  —  p2  sign(£s2*  +  _B(<s2*  —  s2o)l)  (9.26) 

where  s2*  =  [s21, . . . ,  s2m]T.  Let  s2*  =  s2*  —  s20l,  then  Eqn.  (9.26)  can  be  transformed  into 

§2*  =  —  (£  +  B)§2*  —  P2  sign((£  +  B)§2 *)  —  >s2ol  (9.27) 

Choose  Lypapunov  function  E  =  )  YjJLi  s2j,  differentiate  E  along  (9.27),  we  have 

E  =  -sj*(£  +  B)s2*  -  ^2* P‘2  sign((£  +  B)s2*)  ~  52*ls20 
=  -s2*(£  +  B)§2*  ~  slj)2  sign((£  +  B)s2*) 

~  ((£  +  B)§2*)t((£  +  B)T)  1s20l 

Let  be  minimum  eigenvalue  of  ((£  +  5)T)_1,  if 

.  || (£  +  -B)t)-1|||s20| 

"2- - Ti - . 


E  <  — 5l(C  +  B)§2* 

It  can  be  proved  that  E  converges  to  zero.  Therefore,  s2j  converges  s2o-  ■ 

In  Lemmas  5-6  we  have  proved  that  linit_>.0O(^1j  —  z\q)  =  0,  lirrp^co(2:2j  —  z2o )  =  0,  and 
limt^.0O(u1j  —  v10)  =  0.  With  the  aid  of  Lemma  4,  limt_>0O(^3j  —  z30)  =  0.  By  Lemma  3, 
(9.10)  holds.  Next  the  control  laws  for  real  input  t3  are  proposed  with  the  knowledge  of 
v*j  =  bi jiv2j\  designed  in  (9.21)  and  (9.25).  Define 

V*j  =  [hi j,  V2j]  =  [vij  —  <Ti  j,  V2j  —  <t2 j]  , 

we  have  the  following  results. 

Lemma  9.7.  For  m  systems  in  (9.11),  under  Assumption  1,  if  the  communication  graph  is 
connected  and  the  state  of  the  leader  agent  is  available  to  one  of  the  m  follower  systems,  the 
control  laws  for  Tj 

t j  Bj  (  I\  j  a.^j  -)-  h)  ( <,*j ,  Fj ,  z*j ,  7*^ ) dj )  (9.28) 
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and  the  update  laws  for  dj 


dj  j  ( q*j i  7  q*j ^  C*j ) v*j  (9.29) 

for  1  <  j  <  m  guarantee  that  lim^00(sjj  —  s;o)  =  0  for  1  <  i  <  2  and  1  <  j  <  m  mid  dj  is 
bounded. 


Proof:  Substitute  Tj  in  (9.28)  into  (9.11),  we  have 

M-j  (.q*j )/d*j  "h  d-i j  (g*j  f  q*:! )  ^ *j  t  Cy  ( q *j )  ^ j^j*j  t  b)  (q*j  ■>  q*j  •  q*j  ?  q*j ) dj 


The  equation  above  can  be  simplified  as 

MjV*j  +  CjV*j  =  -KjV*j  +  Yjdj  (9.30) 

where  dj  =  dj  —  aj.  Let  the  Lyapunov  function  Vv  =  vJjMjV*j  +  ajTj1^-,  differentiate  Vv 
with  the  aid  of  Property  1  and  (9.30),  we  have 


K 


vJjMjV^j  +  2  vJjMjV^j  +  26^4^  1aj 
-2 vJjKjV*j  <  0 


Therefore,  Vv  is  bounded,  which  means  that  v*j  and  dj  are  bounded.  Furthermore,  it  can  be 
proved  that  v^j  converges  to  zero. 

For  the  systems  in  (9.14)-(9.16),  V\3  =  +  V\3  and  v2j  =  q2 j  +  v2 j-  Next,  we  prove  that 

11111^00(5 ij  —  sio)  =  0  and  lim^00(s2j  —  S20)  =  0.  (9.14)  can  be  transformed  into 

S\j  =  — Ol\S\j  +  C ij  +  V\j.  (9.31) 


Define  V3  =  ■  and  differentiate  it  along  (9.31),  we  have 

V3  =  —ais\j  +  (Ci  j  +  d\j)sij 
<  —  2a1l/3  +  |Cij  +  Vij  |  \J  2  V3 


Define  V4  =  then 

Since  Cij  and  bp  converge  to  zero,  it  can  be  proved  that  V4  converges  to  zero. 
11111^00(5 ij  —  S10)  =  0.  (9.15)  can  be  transformed  into 


V4  <  -aiV4  +  -v=|Ci j  +  vij\. 


Therefore, 


^2*  —  —  (E  +  B)s2*  —  p2  sign((£  +  B)s2 *)  —  S20I  +  v2#-  (9.32) 


where  s2*  =  [s2i,  •  •  • ,  S2m]T-  Choose  a  nonnegative  function  E2  =  Yff'=\  \s2j  and  differentiate 
it  along  (9.32),  we  have 

E2  =  —  s2*(£  +  B)s2*  —  §2*p2  sign((£  +  B)s2*)  —  sJ*(s2ol  —  ^2*) 

—  —  ^2*(-£  +  B)s2*  +  S^V2* 


It  can  be  proved  that  E2  converges  to  zero.  Therefore,  s2j  converges  to  zero  and  s2j  converges 
to  s2o-  ■ 
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Theorem  9.1.  For  the  m  robot  systems  (1  <  j  <  in),  if  the  communication  graph  is 
connected  and  the  state  of  the  leader  agent  is  available  to  one  of  the  m  follower  systems,  the 
control  laws  in  (9.28)-(9.29)  guarantee  that  (9.5)-(9.7)  holds  wider  Assumption  1. 

Proof:  By  Lemma  5-7  we  can  prove  that  lini/^co(siJ  —  si0)  =  0.  limt_>00(vi 3  —  vio)  = 
0  and  Hindoo (s2j  —  S20)  =0.  By  Lemma  f,  lirnt^00(s3j  —  S30)  =  0  holds,  which  means 
limt_>.0O(sjj  —  Si 0)  =  0  and  limt^.00(v1j  —  v10)  =  0.  By  Lemma  3  (9.10)  holds.  Finally  we  can 
prove  (9. 5)- (9. 7)  hold  by  Lemma  1.  ■ 

In  literature,  similar  problems  have  been  considered  in  [152,158].  However,  in  [158]  the 
dynamic  model  is  not  considered  and  in  [152]  the  dynamic  system  is  considered  without  the 
nonholonomic  constraints.  In  this  paper,  we  considered  the  distributed  tracking  problem 
for  uncertain  mechanical  systems  with  nonholonomic  constraints  and  proposed  distributed 
control  laws  with  fast  convergence  rate. 


9.4  Cooperative  Control  Laws  for  Time-varying  Com¬ 
munication  Graph 

In  the  previous  section,  the  communication  graph  is  assumed  to  be  fixed,  in  reality  due  to 
node  and  link  disconnections  and  creations,  the  communication  graph  is  time-varying  or 
switching. 

Theorem  9.2.  For  the  m  robot  systems  defined  in  the  previous  section,  under  Assumption 
1,  if  the  communication  graph  Q  is  time-varying  and  connected  at  any  finite  time  interval 
and  the  state  of  the  leader  agent  is  available  to  one  of  the  m  follower  systems,  the  control 
laws  (9. 28) -(9. 29)  guarantee  that  (9. 5) -(9.7)  holds. 


9.5  simulation 


To  show  the  effectiveness  of  the  proposed  results,  simulation  has  been  done  for  four  robots. 
The  desired  geometric  pattern  V  is  shown  in  Fig.  9.2,  assume  the  format  of  the  robot 
systems  is  in  square  shape.  The  pattern  V  can  be  described  by  orthogonal  coordinates 
(Pix,Piy)  =  (0,0.5),  (p2x,P2y)  =  (-0.5,0),  {p3x,p3y)  =  (0, -0.5)  and  ( pix,p4y )  =  (0.5,0).  For 
the  leading  agent,  assume  the  reference  trajectory  is  (xo,yo,0o)  =  (5sin(f),  —  5cos(f),  t)  and 
C Pox,Poy )  =  (o,  0),  by  (9.4)  v0  =  5  and  cu0  =  1. 

Fig.  9.3  represents  the  communication  graph,  The  cooperative  controllers  can  be  obtained 
by  Lemma  5-6.  We  choose  the  control  parameters  a3i  —  2,  k3  =  2,  b\  =2 ,  pi  =  2,  and  p2  =  2. 
Fig.  9.5  shows  the  centroid  of  x3  (1  <  j  <  4)  (i.e.,  J2j=ixj/ 4)  and  x0.  Fig.  9.6  shows  the 
centroid  of  y3  (1  <  j  <  4)  (i.e.,  Zf/=i  ?7j/4)  and  y0.  Fig.  9.7  shows  {03  —  60 )  (1  <  j  <  4). 

If  the  information  communication  graph  is  time-varying,  the  control  laws  in  Lemma  5- 
6  also  solve  the  defined  control  problem.  Assume  the  information  communication  graph 
switches  according  to  the  following  logic. 


Q 


Q  in  Fig.  9.3,  if  t  —  round (f)  >  0 
Q  in  Fig.  9.4,  if  t  —  round (t)  <  0 
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Fig.  9.8  shows  the  centroid  of  Xj  (1  <  i  <  4)  and  x0.  Fig.  9.9  shows  the  centroid  of  y3 
(1  <  j  <  4)  and  y0.  Fig.  9.10  shows  (d3  —  90)  (1  <  j  <  4). 


9.6  Conclusion 

In  this  paper,  distributed  control  of  multiple  follower  systems  has  been  studied  and  control 
algorithms  were  proposed  for  tracking  trajectory  of  the  leader  agent.  In  the  controller  design, 
dynamics  is  considered  adaptive  controllers  are  designed  for  estimation  of  the  unknown  model 
parameters.  Simulation  results  have  proved  the  effectiveness  of  our  proposed  control  laws. 
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Figure  9.1:  Simplified  model 
wheeled  mobile  robot. 


of  Figure  9.2:  Desired  geometric 
mat  ion. 


for-  Figure  9.3:  Information  ex¬ 
change  graph  Q. 


Figure  9.4:  Information  exchange 
graph  Q  (after  topology  change). 


Figure  9.5:  Response  of  the  Figure  9.6:  Response  of  the 
centroid  of  x3  for  1  <  j  <  4  centroid  of  y3  for  1  <  j  <  4 
and  xq.  and  y0. 


Figure  9.7:  Response  of  (9j 
for  1  <  j  <  4. 


90) 


Figure  9.8:  Response  of  the 
centroid  of  x3  for  1  <  j  <  4 
and  x0- 


Figure  9.9:  Response  of  the 
centroid  of  y3  for  1  <  j  <  4 
and  y0. 


Figure  9.10:  Response  of  (03  —  90)  for 
1  <  j  <  4. 
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Chapter  10 


Teleoperation  of  a  Cluster  of  Mobile 
Robots  Subject  to  Model  Uncertainty 

10.1  Introduction 

In  practice,  many  tasks  are  required  to  be  accomplished  by  multiple  autonomous  robots  coop¬ 
eratively,  such  as  operations  in  hazardous  environments,  manipulation  in  nuclear  processing 
plants,  search  and  rescue  missions,  and  exploration  and  survey.  Due  to  high  requirements  of 
tasks  and  dynamic  environment,  many  tasks  cannot  be  accomplished  alone  by  autonomous 
robots.  Therefore,  it  is  necessary  that  a  human  operator  works  cooperatively  with  multiple 
autonomous  robots.  Bilateral  teleoperation  is  one  type  of  cooperation  between  a  human 
operator  and  a  group  of  autonomous  robots.  The  bilateral  teleoperation  of  a  team  of  robots 
enables  human  operators  to  extend  their  actions  and  intelligence  to  remote  locations  by  al¬ 
lowing  them  to  concentrate  on  high-level  reasoning  and  decision-making  (e.g.  strategic  path 
to  be  navigated  by  the  robot  formation). 

Bilateral  Teleoperation  of  a  single  master  system  and  a  single  slave  system  has  been 
studied  for  over  four  decades.  In  [159] ,  experiments  on  the  effects  of  communication  delay  in 
teleoperation  of  a  single  master  and  single  slave  systems  was  reported.  In  [160],  supervisory 
control  was  developed  to  address  the  problem  of  communication  delays  [160].  In  [161],  a 
Lyapunov-based  analysis  was  proposed  for  teleoperation.  In  [162,163],  the  passivity-based 
approach  was  proposed.  With  the  aid  of  the  passivity-based  approach,  different  subsequent 
schemes  have  been  proposed  in  the  literature  to  provide  performance  improvement  [164-166] . 

With  the  aid  of  the  development  of  cooperative  control  theory  in  the  past  decade  [19,  23- 
28,52,67,167-174],  research  in  bilateral  teleoperation  of  a  single  master  and  multiple  slave 
systems  has  been  reported  in  several  papers. 

In  [175],  coordination  of  a  group  of  Lagrangian  systems  was  considered  with  bidirectional 
communication  constraints.  With  the  aid  of  input-to-state  stability,  PD-type  control  laws 
were  proposed  such  that  the  state  of  a  slave  system  converges  to  a  bounded  region  around 
the  state  of  a  master  system.  In  [176],  bilateral  teleoperation  of  multiple  mobile  vehicles  was 
considered  when  each  slave  vehicle  can  communicate  its  position  and  velocity  to  the  master 
vehicle  and  vice  versa.  PD  controllers  were  proposed  such  that  the  motion  tracking  and  the 
formation  control  are  achieved.  In  [177],  bilateral  teleoperation  of  multiple  mobile  robots 
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was  considered  under  the  assumption  that  the  master  system  has  communication  with  each 
slave  system.  Control  laws  were  proposed  with  the  aid  of  partial  feedback  linearization. 
In  [178],  bilateral  operation  of  multiple  cooperative  robots  with  delayed  communication  was 
considered  under  the  condition  that  the  communication  and  the  computation  are  centralized. 
Control  laws  were  proposed  with  the  aid  of  passive  decomposition. 

In  bilateral  teleoperation  of  a  single  master  and  multiple  slave  systems  research,  most 
of  the  results  were  achieved  based  on  one  or  more  of  the  following  assumptions:  (1)  each 
system  is  not  subject  to  nonholonomic  constraints  [175,176,178];  (2)  there  is  no  dynamic 
model  uncertainty  [177];  or  (3)  the  master  system  can  communicate  with  each  slave  system 
[176].  This  paper  considers  the  problem  of  the  teleoperation  of  a  cluster  of  mobile  robots  that 
appear  as  one  single  virtual  mobile  robot  to  a  remote  human  operator.  The  proposed  control 
design  assumes  the  following:  (1)  each  system  is  subject  to  nonholonomic  constraints;  (2) 
there  is  model  uncertainty  for  each  system;  (3)  the  state  information  of  the  virtual  system  is 
available  only  to  a  subset  of  the  mobile  robots;  and  (4)  the  state  information  of  each  robot 
is  not  available  to  the  virtual  system. 

With  the  aid  of  backstepping  techniques  and  the  results  from  graph  theory,  distributed 
adaptive  control  laws  are  proposed  for  each  robot  such  that  the  group  of  robots  come  into 
a  desired  formation  and  the  centroid  of  the  robot  cluster  moves  along  the  desired  trajectory 
that  is  remotely  specified  by  a  human  operator.  Compared  to  existing  results,  the  advantages 
of  the  proposed  study  are:  1)  starting  from  an  initial  formation,  a  group  of  robots  come  into 
a  desired  formation  the  centroid  of  which  converges  to  the  desired  position  of  a  virtual  robot; 
2)  The  desired  formation  is  achieved  even  though  the  information  about  the  virtual  robot  is 
available  to  only  a  subset  of  the  robots  in  the  cluster. 

10.2  Problem  Statement 

This  paper  considers  the  problem  of  the  tele-operation  of  a  cluster  of  m  car-like  wheeled 
mobile  robots  that  is  controlled  to  move  along  a  pre-defined  path  while  maintaining  a  desired 
rigid  formation.  The  configuration  of  each  robot  is  shown  in  Fig.  10.1.  It  is  assumed  that 
each  robot  is  rigid  and  its  wheels  do  not  slip  along  its  axis.  For  simplicity,  it  is  also  assumed 
that  the  two  wheels  on  each  axle  (front  and  rear)  collapse  into  a  single  wheel  located  at  the 
midpoint  of  the  axle  (car-like  model).  The  front  wheel  can  be  steered  while  the  rear  wheel 
orientation  is  fixed.  The  generalized  coordinates  of  robot  j  are  q*j  =  [xj,yj,9j,9j  +  9?j]T, 
where  ( Xj,yj )  are  the  cartesian  coordinates  of  the  front  wheel,  9j  is  the  orientation  of  the 
robot  body  with  respect  to  the  rr-axis,  and  <pj  is  the  steering  angle. 

Robot  j  is  subject  to  two  nonholonomic  constraints  (one  for  each  wheel): 

Xj  sin(#j  +  (pj)  —  ijj  cos(9j  +  (pj)  =  0  (10-1) 

Xj  sin  9j  —  yj  cos  9 j  =  0  (10.2) 

where  (xj,yJ)  are  the  cartesian  coordinates  of  the  rear  wheel,  Xj  =  Xj  —  ljCos9j,  and  y)'  = 
yj  —  l j  sin  9 j  where  lj  is  the  distance  between  the  wheels.  Substituting  xrj  and  y)’  into  (10.2), 
the  constraints  (10.1)-(10.2)  can  be  written  as 

Jj(q*j)q*j  =  0  (10.3) 
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Figure  10.1:  Configuration  of  a  simplified  car-like  robot. 


where 


sin  {0j  +  cpj)  —  cos  (9j  +  pj)  0  0 
sin  9j  —  cos  9j  l3  0 


(10.4) 


The  dynamics  of  robot  j  can  be  obtained  with  the  aid  of  the  D’Alembert’s  principle  [115] 
and  is  written  as 


Ah) ( ) (j*j  T  Cj Q*j ) Q*j  T  Gj(q*j)  Bj (q*j) Tj 

(10.5) 

where  Mj(q*j)  is  an  4  x  4  bounded  positive-definite  symmetric  matrix,  Cj(q*j,  q*j)q*j  is  cen¬ 
tripetal  and  Coriolis  force,  Gj(q*j)  is  gravitational  force,  Bj(q*j)  is  an  4  x  2  input  transfor¬ 
mation  matrix,  Tj  is  control  input,  Xj  is  the  constraint  force  on  system  j,  and  the  superscript 
T  denotes  the  transpose  operator.  It  is  well-known  that  the  following  properties  hold  for 
the  dynamics  (10.5):  1.  ( Mj  —  2Cj)  is  a  skew-symmetric  matrix;  and  2.  For  any  vector 
f  e  A4.  Mj(q^)i  +  Cj{q^,q^)i  +  Gj(q^)  =  Yj(q^,  q*j,  f,  £)/%,  where  Yj(qmj,  q*j,  £,  £)  is  a 
matrix  function  of  q+j,  q*j,  £,  and  ^  and  is  called  the  regressor  matrix,  and  (3j  is  the  inertia 
parameter  vector.  In  this  paper,  it  is  assumed  that  the  regressor  matrix  Fj(g*j,  q*j,  £,  £)  is  a 
known  matrix  and  the  inertia  parameter  vector  f3j  is  unknown  and  needs  to  be  estimated. 

The  robots  in  the  cluster  are  assumed  to  exchange  data  between  them  using  on-board 
sensors  and  wireless  communication.  If  each  robot  is  considered  as  a  node,  the  communi¬ 
cation  between  robots  can  be  described  by  a  graph  Q  =  {V,  £},  where  V  =  {1,  2, ... ,  m}  is 
a  node  set,  S  is  an  edge  set  with  element  etj  that  describes  the  information  flow  from  node 
i  to  node  j.  Robot  i  is  referred  to  as  a  neighbor  of  robot  j  if  the  information  of  robot  %  is 
available  to  robot  j.  For  robot  j,  the  indices  of  its  neighbors  form  a  set  denoted  by  Mj.  This 
study  considers  a  bidirectional  communication  between  a  robot  and  its  neighbors.  A  graph 
Q  is  called  to  be  connected  if  for  any  two  nodes  there  is  a  set  of  edges  which  connect  the  two 
nodes. 

For  m  robots,  a  desired  formation  T  is  defined  by  coordinates  {pXjiPyj)  (1  <  j  <  m )  that 
satisfy  i  Pxj  =  0  and  MJL i  Pyj  =  0.  Fig.  10.2  shows  an  example  of  a  desired  formation  of 
a  cluster  of  five  robots  (m  =  5). 

The  cluster  of  m  robots  is  said  to  be  in  the  desired  formation  T  if  x3  —  Xi  =  pXj  —  pXi 
and  yj  -yi  =  pyj  -  pyi  for  1  <  j  ^  i  <  m. 
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Figure  10.2:  An  example  of  desired  rigid  formation.  The  virtual  robot  occupies  the  centroid 
position. 


In  order  to  telecommand  a  cluster  of  mobile  robots,  a  human  operator  controls  a  system 
whose  position  states  are  the  desired  trajectories  of  the  centroid  of  the  robot  cluster.  The 
system  that  is  controlled  directly  by  a  human  operator  is  called  a  virtual  mobile  robot.  The 
virtual  mobile  robot  is  represented  by: 

MQ*o)<i*o  =  0  (10.6) 

Mo(q*o)q*o  +  Co(q*o,  q*o)q*o  +  Co(g*o) 

—  B0(q^0)Th  +  Jj  (q*o)^Oj  (10.7) 

where  g* 0  =  [xo,yo,9o,9o  +  9?o]T  is  the  generalized  coordinates  of  the  virtual  mobile  robot, 
Jo  is  defined  in  (10.4)  with  j  =  0,  Mo,  Co,  Co,  and  Bq  are  known  matrices,  Ty  is  the  external 
input  of  a  human  operator.  System  (10.6)-(10.7)  is  a  virtual  system.  The  state  g*0  and 
its  derivatives  are  available  to  one  or  more  mobile  robots  via  wireless  communication.  For 
convenience,  the  virtual  robot  in  (10.6)-(10.7)  is  labeled  as  robot  0.  The  virtual  robot  is 
assumed  to  communicate  to  a  subset  of  the  mobile  robots.  If  the  virtual  robot  and  the  m 
mobile  robots  are  considered  as  a  group  of  (m  +  1)  robots,  the  communications  between 
robots  can  be  described  by  a  graph  Qe  with  (m  +  1)  nodes.  A  neighbor  set  of  robot  j  is 
denoted  by  A f?.  The  problem  considered  in  this  paper  is  defined  as  follows. 

Control  Problem:  For  a  desired  formation  T  and  a  desired  trajectory  (rro,2/o),  the 
control  problem  is  to  design  a  distributed  cooperative  control  law  for  robot  j  using  its  own 
state  q*j,  its  neighbors’  state  g*?;  for  i  G  A/)e,  and  the  desired  formation  information  (pXj,Pyj) 
and  ( PxiiPyi )  for  i  G  Afj  such  that  the  m  robots  come  into  the  desired  formation  and  the 
centroid  of  the  position  of  the  mobile  robots  converges  to  the  position  of  the  virtual  robot, 
i.e., 


lim  (xj  -  Xi)  =  pxj  -  pxi, 

lirn  (yj  -  yt)  =  pyj  -  pyi ,  for  1  <  i  ^  j  <  m. 


liin  f  —  ~x0(t)  J 

(  1  m  \ 

o(t) 

00  \rnp{  J  J 


=  0 

=  0. 


(10.8) 

(10.9) 

(10.10) 

(10.11) 


132 


The  considered  control  problem  introduces  key  challenges  that  make  the  proposed  study 
different  from  existing  research  in  bilateral  teleoperation  of  a  master  system  and  multiple 
slave  systems.  These  key  challenges  are:  1)  the  model  of  each  robot  is  a  nonholonomic 
dynamic  system ;  (2)  the  model  of  each  robot  is  not  exactly  known ;  (3)  the  state  of  the 
virtual  robot  is  not  available  to  each  robot;  and  4)  there  are  communication  delays  between 
systems. 

10.3  Controller  Design 

The  system  described  by  (10.3)-(10.5)  is  transformed  into  a  cascade  structure  as  discussed 
next.  It  is  assumed  that  each  robot  is  front  wheel  driving.  Hence,  the  constraint  (10.3)  can 
be  written  as 

cos  5j  0 

i*j=  sin  (fij/lj  0  V2j  =9^V*j  (1(U2) 

0  1  J 

where  Sj  =  9j  +  (pj,  V\j  and  v2j  are  the  driving  input  and  the  steering  velocity  input,  respec¬ 
tively.  Differentiating  both  sides  of  (10.12)  and  substituting  it  into  (10.5)  and  multiplying 
both  sides  by  gj{q*j)T ,  one  has 

T/j  (g*j)  k*j  T  Cj  ,  Q*j T  G  j  ( Q*j )  B j ( g *j ) Xj  (10.13) 

where  it  is  applied  the  fact  that  gj  (q*j)  Jj  (q*j)  =  0,  and  Mj  =  gj Mjgj,  Cj  =  gj Mjijj 
+gJCjgj,  Gj  =  gjGj ,  and  B3  =  gjBj. 

System  (10.12)-(10.13)  describes  the  motion  of  system  (10.3)  and  (10.5).  Therefore,  the 
defined  control  problem  can  be  solved  based  on  system  (10.12)-(10.13)  instead  of  system 
(10.3)  and  (10.5).  System  (10.12)  is  called  the  kinematics  of  system  j.  System  (10.13)  is 
called  the  dynamics  of  system  j. 

Noting  that  the  system  in  (10.12)-(10.13)  has  a  cascade  structure,  a  backstepping  based 
approach  with  two  steps  is  proposed.  In  the  first  step,  the  dynamics  (10.13)  are  ignored  and 
v*j  is  assumed  to  be  a  virtual  control  input.  Distributed  control  laws  v*j  will  be  proposed 
for  a  group  of  m  systems  (1  <  j  <  m)  in  (10.12)  such  that  (10.8)-(10.9)  are  satisfied.  In 
the  second  step,  the  dynamics  (10.13)  are  taken  into  consideration  and  distributed  control 
laws  Tj  will  be  designed  for  the  systems  in  (10.12)-(10.13)  with  the  aid  of  the  results  in  the 
first  step  and  backstepping  techniques  such  that  eqn.  (10.8)-(10.9)  are  satisfied.  In  order  to 
highlight  the  basic  ideas,  communication  delays  are  not  considered. 

10.3.1  Step  1:  Controller  Design  for  Kinematic  Systems 

In  order  to  design  distributed  control  laws  v*j  (1  <  j  <  m )  for  systems  (10.12)  such  that 
(10.9)  is  satisfied,  we  introduce  the  following  new  variables 

=  Xj  —  pXj  +  r  cos  5j 
=  Vj-l'yj  “ 


zij 

z2j 
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(10.14) 

(10.15) 


for  0  <  j  <  m,  where  r  (^  0)  is  a  small  positive  number  which  can  be  chosen  by  the  designer, 
px o  =  0  and  py0  =  0.  Then 


ZU 

z2j 


V, 


vij 

V2j 


(10.16) 


where 

cos  Sj  —  r  sin  Sj 
sin  Sj  r  cos  Sj 

It  can  be  verified  that  Vj  is  nonsingular  if  r  ^  0. 

Lemma  10.1.  For  the  m  systems  in  (10.16),  if  the  communication  graph  Q  is  connected, 
the  control  laws 

vij  =  rjij,  v2j  =  rj2j  (10.17) 

for  1  <  j  <  m  guarantee  that 


lim  (zij  -  zu)  =  0,  lim  (z2j  -  z2i)  =  0 

t—>  oo  t—>  oo  J 


for  0  <  i  ^  j  <  m,  where 


Vij 
V2  j 


X  )  ji  (z\j  Zli) 
Plj  XX  aji(zlj  —  zli) 

ieA/j _ 


N 


X/  ajiizlj 

ieAr; 


+h(t ) 


XX  aji(z2j  Z2i) 
ieA/i 

P2j  XX  aji(Z2j  —  z2i) 

_ 


N 


XX  aji(Z2j 


+h(t) 


(10.18) 


(10.19) 


aji  =  aij  >  0,  pij  and  p2j  (1  <  j  <  m)  are  sufficiently  large  constants,  h(t )  is  nonnegative 
and  yjh(t)  is  an  integrable  time  function. 

Proof:  Define  zij  =  Zij  —  Zio,  then 


Zlj 


XX  aji(zlj  Zli) 

Plj  >  )  Hji{zij  Zu') 
ieN? 


\ 


/ 


-xwl 


>  )  Hji{z\j  Zu )  +  h 


ieMf 
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for  1  <  j  <  m.  Let  a  Lyapunov  function  V  —  zf_(£  +  diag[ai0,  a2o,  •  •  • ,  amo})zi*  where 
z i*  =  [^ii,  Z12,  •  •  • ,  hm],  £  is  the  Laplacian  matrix  of  the  communication  graph  Q,  differentiate 
V  along  the  solutions  of  the  systems,  with  the  aid  of  the  results  in  [179]  we  have  V  <  —zj*(£+ 
diag[«io,  a2o,  •  •  • ,  amo])22i*  +  VhYfjLi  Pij  if  Pij  is  sufficiently  large.  It  can  be  proved  that  z\3 
converges  to  zero.  Similarly,  we  can  show  that  z^j  converges  to  zero  if  p\3  is  sufficiently  large. 

■ 

In  Lemma  10.1,  h(t)  can  be  l/ta  for  a  >  2,  e~at  for  a  >  0,  or  other  functions.  For 
simplicity,  we  can  choose  h  to  be  a  small  positive  constant  in  Lemma  10.1  and  it  can  be 
shown  that  [z\3  —  z\q)  and  (z2j  —  Z20)  converge  to  a  small  neighborhood  of  the  origin. 

In  Lemma  10.1,  p\3  and  p23  should  be  large  enough.  If  the  upper  bounds  of  p\3  and  p2j 
are  not  known  in  advance,  they  can  be  estimated  on-line  as  follows. 

Lemma  10.2.  For  the  m  systems  in  (10.16),  if  the  communication  graph  Q  is  connected, 
the  control  laws  (10.17)  for  1  <  j  <  m  guarantee  that  (10.18)  hold  for  0  <  i  ^  j  <  m,  where 


Pij 

m  j 


Pij 


=  *il 


( 


7ii 


f  ]  Uji{Z\j  Z\f) 

Pij  aji(zlj  ~  Z1  i) 

i&Aff 


aji(z2j  %2i) 

iSA/i 

p2j  aji(Z2j  ~  z2i) 
ieUf 


y  aji(z2j  —  %2i)  )  +h(t) 


y!  aji{zlj  zli) 


\ 


J2  ajfztj  -  zH)  +  hit) 


i£  Nf 


(10.20) 


(10.21) 


/ 


72i 


y  aji{z2j  %2 i) 


P2j  ~ 


ieJV? 


\ 


( 


aAZ2 j  ~  z2i)  +  h(t) 


ieMf 


(10.22) 
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a,ji  >  0,  71  j  and  72 j  are  positive  constants,  h(t)  is  nonnegative  and  \Jh{t)  is  an  integrable 
time  function. 

The  proof  of  Lemma  10.2  is  omitted  due  to  space  limitation. 


10.3.2  Step  2:  Controller  Design  for  Dynamics  Systems 

In  this  step,  the  dynamics  (10.13)  are  taken  into  consideration.  The  control  laws  will  be 
designed  with  the  aid  of  backstepping  techniques  and  robust  control  theory.  In  order  to 
design  Tj,  let  Vy  =  Vy  —  r]\j  and  v2j  =  v2j  —  V2 j,  then  the  systems  in  (10.16)  and  (10.13)  can 
be  written  as 


Zij  =  —  ^  ciji(zij  —  Zu)  +  Vij  cos  5j  —  v2jr  sin^j 


ieATj 


Plj  )  )  %\i) 

ieAff 


\ 


( 


aji(Zlj  Zli)  I  +  h(t) 

ieAff 


z2j  =  -  aji(z2j  -  z2i)  +  vij  Sin  Sj  +  v2jr  cos  5j 


ieAff 


P2j  aji{z2j  Z2 i) 

ieAff 


\ 


( 


5Z  aji(z2j  -  z2i)  I  +  h{t) 

ieAff 


MjV*j  +  CjV*j  —  BjTj  +  CjT)*j  +  Gj) 

for  j  ^  0 

M0v*o  +  C0v*0  =  B0(t0  +  rh)  -  (M0? 7*0 

+Co7*o  +  Go) 


(10.23) 


(10.24) 


(10.25) 


(10.26) 


where  h,  =  [vij,v2j\T ,  Mj  =  (.yT/.)  MjgfV f,  =  (g^ j)T Mj|(^'F j)  +  igfl1 ;)  CjgfVj. 
Gj  =  (gj^j)TGjf  and  Bj  =  {gfi f)T Bj.  For  the  systems  in  (10.26),  the  following  two 
properties  can  be  proven:  1.  {Mj  —  2 Gj)  is  a  skew-symmetric  matrix;  and  2.  For  any  vector 
f  e  R%  Mj{q*j)i  +  Gjiq.  j.  <).■,)  f  +  Gj(q*j)  =  Yj{q*j,q*j,€,£)Pj,  where  Yj{q*j,  q*j,  f,  f)  is  a 
matrix  function  of  q*j ,  q¥J ,  £,  and  f. 

Lemma  10.3.  For  (m+1)  systems,  if  the  communication  graph  Qe  is  connected,  the  control 
laws 


Ti 


Pi 


B 


-1 


-  KjV*j  H-  Yj  {q*j ,  Q*j->  r]*j  5  V*j^)  ft  j 


A  *j] 

— (hi  h*ji  v*j)  v*j 
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(10.27) 

(10.28) 


guarantee  that  z*j  converges  to  z*0  and  that  fi3  is  bounded,  where  is  a  positive  constant 
matrix,  Ay  =  [Ay,  A2j-]t,  Ay  =  cos  S3  aji(zij  ~  zu)  +  sin  Eie at;  aji(z2j  ~  z2i),  A 2j  = 

— r  sin  Sj  J2ieN?  aji(zij  ~  zu)  +  r  cos  Sj  XaeA/"?  aji(z2j  ~  z2i),  Vij  and  rj2j  are  defined  in  (10.19) 
or  (10.20). 

Proof:  If  r/y  and  rj2]  are  defined  in  (10.19),  let 

m 

V  =  zj* (£  +  diag[ai0,  •  •  • ,  am0])zu  +  X  vJjMjV*] 

3= 1 

+z]fiC  +  diag[oi0,  •  •  • ,  amo])^2* 

m 

+£(ft-ft)Tr71(ft-ft)  (10.29) 

3= 1 

Differentiating  it  along  the  solution  of  the  system  (10.23)-(10.26),  we  have 

V  <  -zJfiC  +  diag[oi0, . . . ,  am0])2^i* 

+  diag[aio,  •  •  • ,  amo])2^2* 

m  m 

-2  X *3  K 3^*3  +  X0°L  +  P2i)Vh  (10.30) 

3= 1  3=1 

it  can  be  shown  that  D  is  bounded,  which  means  that  ffi  is  bounded.  Furthermore,  it  can 
be  shown  that  (zi3  —  z\q),  (z2j  —  z2fi),  and  hy  converge  to  zero. 

If  r/y  and  r/2j  are  dehned  in  (10.20),  the  results  can  be  proved  similarly.  ■ 

With  the  aid  of  Lemmas  10.3,  the  following  results  are  obtained. 

Theorem  10.1.  For  m  robots  and  a  virtual  system  operated  by  a  human  operator,  if  the 
communication  graph  Qe  is  connected,  the  control  laws  in  Lemma  10.3  guarantee  that 


lim  | xj  -  x%  -  pxj  +pxi\  <  2 r, 


£—>•00 


lim  |  y3  —  yi  —  pyj  +  pyi  |  <  2  r,  for  1  <  i  ±  j  <  m. 


lim 

£— >•  oo 


lim 

£— >■  OO 


2  m 

J2xj(t)  -x0(t) 


m  3=1 


1  m 

-yo(t) 


m  3=1 


<  2  r 


<  2r 


(10.31) 

(10.32) 

(10.33) 

(10.34) 


and  that  f3j,  p\3,  and  p2j  are  bounded,  where  the  control  parameters  are  defined  in  Lemma 
10.3. 


Theorem  10.1  can  be  proved  with  the  aid  of  Lemma  10.3  and  the  proof  is  omitted  here. 

Remark  10.1.  In  Theorem  10.1,  r  can  be  chosen  as  small  as  possible.  However,  small  r 
value  leads  to  large  control  inputs.  In  practice,  r  should  be  chosen  according  to  the  tradeoff 
of  magnitudes  of  control  inputs  and  tracking  errors  between  systems. 


137 


Remark  10.2.  In  this  paper,  the  regressor  matrix  of  each  system  is  assumed  to  be  known.  If 
the  regressor  matrix  is  unknown,  distributed  robust  adaptive  controller  can  be  proposed  with 
the  aid  of  robust  and  adaptive  control  theory.  If  approximation  theory  is  applied  to  estimate 
unknown  terms,  distributed  approximation-based  adaptive  controllers  can  be  proposed.  Due 
to  space  limitation,  we  omit  them  here. 


10.4  Simulation 


To  show  the  effectiveness  of  the  proposed  control  design,  two  simulation  cases  of  the  tele¬ 
operation  of  five  mobile  robots  are  considered.  The  dynamics  of  each  mobile  robot  can  be 
found  in  [180]  and  are  not  presented  here  due  to  space  limitation.  The  virtual  robot  is 
described  by  (10.6)-(10.7).  For  simplicity,  we  assume  that  M0  —  I,  C0  —  0,  G0  =  0,  and 
Bo  =  diag[l,  1].  The  communication  graph  between  the  five  robots  is  illustrated  in  Fig.  10.3, 
where  the  information  about  the  location  of  the  virtual  robot  (robot  0)  is  assumed  to  be 
available  only  to  robot  5.  The  desired  robot  formation  is  specified  in  Fig.  10.6.  The  control 
laws  of  Theorem  10.1  are  implemented  to  solve  the  control  problems.  In  the  first  simulation 
example,  the  robot  cluster  is  tele-commanded  so  that  it  forms  the  desired  rigid  formation 
and  moves  along  a  circular  path  while  maintaining  that  desired  formation.  Figs.  10.4-10.5 
show  the  response  of  transformed  position  vector  [z\j,  Z2j]T ■  Fig.  10.6  shows  that  starting 
from  an  initial  formation,  the  robot  cluster  moves  to  form  the  desired  formation,  and  then 
moves  along  the  desired  circular  path  while  maintaining  the  desired  formation. 


3  <  5). 
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represent  the  desired  rigid  formation 
maintained  by  the  cluster  while  mov¬ 
ing  along  the  desired  circular  path. 


10.5  Conclusion 

This  chapter  considered  teleoperation  of  one  master  system  and  multiple  slave  systems.  Dis¬ 
tributed  adaptive  controllers  were  proposed  with  the  aid  of  backstepping  techniques  and  re¬ 
sults  of  graph  theory.  Simulation  results  have  demonstrated  the  effectiveness  of  the  proposed 
control  approach.  In  this  paper,  the  effects  of  communication  delays  were  not  discussed.  Fu¬ 
ture  work  will  take  the  communication  delays  into  consideration. 
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Chapter  11 

Consensus  of  Multiple  Nonholonomic 
Mechanical  Systems  with  Non-ideal 
Nonholonomic  Constraints 


In  this  chapter,  we  consider  Problem  3  defined  in  the  last  chapter,  i.e.,  the  consensus  problem 
of  multiple  nonholonomic  mechanical  systems  in  (1.1)  and  (1.10).  Since  (1.11)  and  (1.4)  are 
equivalent  to  (1.1)  and  (1.10),  the  consensus  problem  is  considered  based  on  (1.11)  and 
(1.4).  In  order  to  design  distributed  control  laws,  we  solve  the  problem  in  two  steps.  In 
the  first  step,  we  assume  that  u*3  are  control  input  and  design  distributed  algorithms  using 
neighbors’  information  such  (1.8)  is  satisfied.  In  the  second  step,  we  design  control  law  Tj 
using  neighbors’  information  such  that  (1.8)  is  satisfied. 

11.1  Distributed  Controller  Design  for  Kinematic  Sys¬ 
tems 

Consider  m  systems  in  (1.12),  i.e., 


—  Vij  +  <f>ij(xij) 

(11.1) 

X2j 

—  v2  j  +  <f>2j(%2j) 

(11.2) 

Xij 

VjjX'i—  i  j  0ij  (xij ) ,  3  t  ii 

(11.3) 

The  communication  between  systems  is  defined  by  a  directed  graph  Q  =  {V,  £}.  For  simple 
presentation,  it  is  assumed  that  the  communication  between  systems  is  bi-directional  in  this 
chapter. 

The  considered  problem  is  defined  as  follows. 

Consensus  of  Multiple  Chained  Systems:  For  a  group  of  m  systems  in  (11.1)-(11.3), 
the  problem  is  how  to  design  a  distributed  control  law  (uq,  V2j)  for  system  j  based  on  its 
own  information  and  its  neighbors’  information  such  that 

lim  (x*j  —  c)  =  0,  1  <  j  <  m,  (11.4) 
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where  x*j  =  [jy, . . .  ,xnj]T  and  c  is  an  unprescribed  constant  vector  which  depends  on  the 
initial  condition  of  each  system  and  the  topology  of  digraph  Q. 

The  system  (11.1)-(11.3)  has  a  cascade  structure.  (11.1)  is  a  linear  system  with  a  pertur¬ 
bation  term.  For  controller  design,  it  is  assumed  that  the  uncertain  terms  in  (11.1)- (11. 3) 
satisfy  the  following  conditions: 

\Mxv)\  <  7i \<hj(x2j)\  <  72 i(%),  \<i>ij{xij)\  <  laixij),  3  <i<n  (11.5) 

where  are  known  positive  functions. 

With  the  aid  of  the  results  in  [7],  we  have  the  following  results. 

Lemma  11.1.  For  the  system  in  (ll.l)-(ll.S),  there  exists  a  function  fj(P*j,Cj)  G  Rn  such 
that  the  the  matrix  Gj(/3*j )  =  9ij{fj),92j{fj),  ....  is  nonsingular  for  any  (3*j 

and  6j  >  0,  where  gXj  =  [1,  0,  x2j,  •  •  • ,  zn-ij]T ,  92j  =  [0, 1,  0, ... ,  0]T,  (3^  =  \P \ji . . . ,  pn_2 ,j\T , 
P  G  Rn~2  and  the  function  fj  has  the  following  properties: 

1.  fj  is  bounded  for  any  P^; 

2.  lime._x, fj(P*j,€j)  =  0. 

The  proof  of  Lemma  11.1  can  be  found  in  [7,  8].  The  construction  of  fj  can  be  found  also 
in  [7,8].  The  function  fj  is  called  the  transverse  function. 

With  the  aid  of  Lemma  11.1  and  the  notations  in  [7],  it  can  be  found  the  function  fj(Pj,  6j) 
such  that  Gj  is  nonsingular.  Let 

X-xj  f  j  (  p*j  ) 

then,  we  have  the  augmented  system 

Z*j  ^‘rfjt/3a,j)~1{‘^*j)^ztj{fj{P*j))Gj{P*j)[vij,Z>2j,  Plji-'-j  Pn—  2j]  (11.6) 

We  define  the  neighbors’s  difference  as 

&*j  •  •  •  j  &nj\  'y  ]  %*i)-  (11-7) 

ieW 

If  P*j  is  considered  as  an  additional  input,  we  propose  the  following  distributed  control  law. 

Theorem  11.1.  For  the  m  systems  in  (ll.l)-(ll.S),  if  the  communication  graph  has  a 
spanning  tree,  the  control  law 


Vl  j 

=  Vl  j 

(11.8) 

V2  j 

=  V2  j 

(11.9) 

Vl  j 

~ 

V2j 

z  ~Gj1dlz-i  (x*j)dr  (z*j) 

^  ^  CLji(z*j  %*i)  ^*j 

(11.10) 

~P*j  _ 

ieAfj 
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ensures  that 


lim  || x*j  -  x*i\\  <  Sji(ej,  €i)  (11.11) 

where  Sji  is  a  nonnegative  continuous  function  of  e3  and  e*  and  53i  converges  to  zero  when  e3 
and  et  converge  to  zero,  and 


71? ei? 


fe*  -|-e 

nj  1 


(11.12) 


Proof:  By  Lemma  11.1,  Gj  is  nonsingular.  So,  the  control  law  exists.  Substitute  the 
control  law  into  the  system,  we  have 


_  Tijeij  ,  M 

Zlj  ~  -el 1 - /  9  +  01  1 

+ e_t 


_  _  _  Inj^nj 

^ nj  c ni  i — r - 


-nj 


+  e- 


'nj 


Choose  a  function 
where  =  [zn, . . . ,  ^n]T  and  C  is  the  Laplacian  matrix,  we  have 


V  —  z  rz. 


m  _  ,p2  m 

V,  =  -z7,c^-T.  ,y  “  +E^, 


j= 1  \  (ii  +  <  '  t=i 


m  g-t 


+  X^ll* 


A  —zJ*C2Zi*  —  ^  7i?y efj  +  e  *  +  ^  _ 

1=1  1=1  \J  eij  +  e  *  1=1 

<  ^z-X-2Zi*  +  me~t/2 


'Ol 


(11.13) 

(11.14) 

(11.15) 


By  integrating  both  sides  of  the  above  inequality,  it  can  be  shown  that  z ;*  is  bounded  and 
Az**  converges  to  zero,  which  means  that  (%  —  zu)  converges  to  zero  for  1  <  j  ^  l  <  m. 
Therefore,  (11.11)  holds.  ■ 

Remark  11.1.  If  6j  (1  <  j  <  rn)  are  chosen  to  be  small  constants,  S3t(e3, ef)  is  a  small 
constant,  which  means  that  \\x*j  —  a;** ||  converges  to  a  small  neighborhood  of  the  origin.  We 
say  (11 .4)  is  achieved  practically. 

Remark  11.2.  In  Theorem  11.1,  nothing  is  said  about  j3*j.  So,  /3*j  may  be  bounded  or 
unbounded.  Thanks  to  the  properties  of  the  function  fj,  the  boundedness  of  (3* j  plays  no  role 
in  the  consensus  problem. 
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11.2  Distributed  Controller  Design  for  Dynamical  Sys¬ 
tems 

We  considered  m  dynamical  systems.  The  j- th  system  is  defined  as 


Xij  =  Vi  J  +  (11.16) 

±2j  =  v2j  +  <i>2j{x2j)  (11-17) 

Xij  =  vijXi-ij  +  (f>ij(xij),  3  <i  <n  (11.18) 

+  Gj  +  Dj  =  BjTj  (11.19) 


where  v*j  =  [u\v  v2j\t  and  =  [x\v  . . . ,xnjY .  The  following  properties  are  satisfied. 

Property  11.1.  Mj  is  bounded  and  Mj  —  2 Cj  is  skew- symmetric. 

Property  11.2.  For  any  differentiable  vector  £  G  R2 , 

■Mjf  T  CjZ  T  Gj  Y(X*j,  x*j ,  f f ) Oj 

where  Yj  is  a  known  function  of  x*j,  x*j,  f,  and  f,  and  aj  is  the  inertia  parameter  vector. 
The  problem  considered  in  this  section  is  defined  as  follows. 

Consensus  of  Multiple  Systems:  For  a  group  of  m  systems  in  (11. 16)-(11. 19) ,  the 
problem  is  how  to  design  a  distributed  control  law  Tj  for  system  j  based  on  its  own  informa¬ 
tion  and  its  neighbors’  information  such  that 

lim  (x*,  —  c)  =  0,  1  <  j  <  m,  (11.20) 

t— >oo  J 

where  =  [ly, . . . ,  xnfT  and  c  is  an  unprescribed  constant  vector  which  depends  on  the 
initial  condition  of  each  system  and  the  topology  of  digraph  Q. 

In  the  dynamics  (11.19),  we  first  assume  that  the  inertia  parameter  vector  aj  is  a  constant 
and  is  unknown. 

In  order  to  design  controllers,  we  let 

vij  =  vij  -rjij  (11-21) 

V2  j  =  v2j-rj2j,  1  <j<m  (11.22) 

where  rj ij  and  rj2]  are  defined  in  (11.8)  and  (11.9),  respectively.  Let 

Xj  ~  =  rfj(p*j)-1{x*j)<M,ztj(fj(f3*j))Gj(/3*j) 

then  we  have 


Zij  = 

ei  j 

\ 

hjeij 

=  +  <t>l  j  +  j  +  Xl,2,jV2j 

(11.23) 

/e?i  +  e' 

z2j  = 

-e2j - 

72 je2j 
/  o 

=  +  02  j  +  X2,l,jVij  +  X2,2,jV2j 

(11.24) 

M+e' 

Zij  = 

~eij 

V 

7  ijeij 

=  +  4>ij  +  +Xi,l,jVlj  +  Xi,2,jV2j,  3  <  i  <  n 

(11.25) 

'e2j  +  e- 

MjV*j 

+  CjV*j 

=  BjTj 

-  ( Mjf]*j  +  Cj-rj^j  +  Gj  +  Dj) 

(11.26) 
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where  v*j  =  [v\j,v2j]T. 

For  the  dynamics  of  each  system,  we  have 

MjV*j  +  CjV*j  +  Gj  =  Yj(x*j,x*j,Ti*j,Ti*j)(ij 

where  dj  is  the  inertia  parameter.  For  the  disturbance  Dj,  it  is  assumed  that 

1 1 G)  j  1 1  ^  pj(x*j) 


(11.27) 


(11.28) 


where  pj  is  a  known  function  of  x*j.  If  the  inertia  parameter  dj  is  a  constant  and  is  unknown, 
we  have  the  following  results. 


Theorem  11.2.  For  the  m  systems  in  (11.16)-(11.19),  if  the  communication  graph  has  a 
spanning  tree,  the  control  law 


rl  =  Bj 


-l 


—KjV*j  +  Yjhj  -  pjsign(v*j)  - 


aj  —  r  fYj  v*j 


(11.29) 

(11.30) 


ensures  that  dj  is  bounded  and  (11.11)  holds,  where  Kj  and  Tj  are  positive  constant  matrices, 
and 


A,- 


n 

i=  1 
n 

_  i=  1 


(11.31) 


Proof:  Let 

n  my  my 

v  =  J2  zj*£zi*  +  +  ]T  2  («J  -  aj)  1 ' '  ( (lj  -  aj) 

i=  1  1= 1  Z  3=  1  ^ 

Differentiating  it  along  the  closed-loop  system,  we  have 

n  m  m  m 

v  <  zlc2zi*  -  X  vJjKjVtj  -  ]T  PjvJjSign&j)  ~  X  vJfij  +  me_t/2 

*=i  i=i  l=i  l=i 

n  m 

<  -  X  zi£2zi*  -  X  +  me_t/2 

*=i  1=1 

By  integrating  both  sides  of  the  above  inequality,  it  can  be  shown  that  V  is  bounded,  which 
means  that  z^,  v*j  and  dj  are  bounded.  Furthermore,  it  can  be  shown  that  by  Barbalat’s 
lemma  that  e **  and  v*3  converge  to  zero.  Therefore,  (11.11)  holds.  ■ 

In  Theorem  11.2,  the  unknown  inertia  parameter  is  estimated  by  an  adaptive  control  law. 
If  an  estimate  of  dj  is  dj  and 

\\dj  -  dj\\  <  7 j 

for  1  <  j  <  m  and  7 j  is  a  known  constant,  we  propose  the  following  robust  control  laws. 
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Theorem  11.3.  For  the  m  systems  in  (11.16)-(11.19),  if  the  communication  graph  has  a 
spanning  tree,  the  control  law 


=  B 


-i 


-KjV*j  +  YjOj  -  7j Yj sign ( Yj  v*j )  -  pJsign({;*J)  -  A3 


(11.32) 


ensures  that  (11.11)  holds,  where  K}  is  a  positive  constant  matrix  and  A j  is  defined  in 
(11.31). 


Proof:  Let 

n  m  ^ 

v  =  ^2  zJ*£zi*  +  I]  - vJjMjiUj 

i= 1  3= 1 Z 

Differentiating  it  along  the  closed-loop  system,  we  have 


n  m  m  m 

Vj  <  ~Y  zJ*£2zi*  ~  Y  -  Y.  PjvJjSi gn(u*j)  -  5] 

*=i  l=i  i=i  l=i 

m  m 

+  51  ®J^l(«l  -  %)  -  51  IjvJjYjSigniY^v^)  +  me"1/2 
l=i  l=i 

n  m 

<  E  zJ*£2zi*  ~  Y  vJjKjV*j  + 

i=l  1=1 


Therefore,  V"  is  bounded,  which  means  that  z j*  and  v*j  are  bounded.  By  Barbalat’s  lemma, 
it  can  be  shown  that  ew  and  converge  to  zero.  ■ 

In  Theorem  11.3,  the  unknown  inertia  parameter  aj  is  not  required  to  be  a  constant.  In 
the  control  laws,  7 j  is  required  to  be  known.  It  is  possible  to  estimate  it. 


11.3  Simulation 

We  considered  three  nonholonomic  wheeled  mobile  robots  considered  in  Section  3.5. 

The  constraint  on  the  front  wheels  can  be  written  as 

Xj  sin  9j  —  yj  cos  9j  =  Pj(xj,  ijj)  (11.33) 

where  (xj,  tjj)  is  the  position  of  robot  j,  9j  is  the  orientation  of  robot  j,  and  Pj  denotes  slight 
slipping  along  the  axis  of  the  wheels.  The  dynamics  of  robot  j  are  described  by  the  following 
differential  equations 

1 

nijXj  =  Xj  cos  9j  +  —  [Tij  +  r2j)  cos  9 j 

ill 

1 

<  uijjjj  =  -Xjsm9j  +  —  (t^  +  T2j)sm9j  (11.34) 

ill 

L 

iAi  =  w(rL  -  r2j) 

Kj 

where  rrq-  is  the  mass  of  robot  j,  and  Ij  is  its  inertia  moment  around  the  vertical  axis  at 
point  Q.  Rj  is  the  radius  of  the  wheels  and  2 Lj  the  length  of  the  axis  of  the  front  wheels, 
and  T\,j  and  t2j  are  the  torques  provided  by  the  motors. 
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Let  q*j  Xj,yj,  Oj  - 


rrij  0  0 

0  rrij  0 

0  0  L 


i  ' j  ( (1  *j  ■  q*j )  ff  ^ j  ( 0 


Bj  (q*j) 


R-i 


cos  Oj  cos  Oj 
sin  Oj  sin  Oj 
Lj  ~Lj  j 


,  Jj  =  [sin  Oj,  —  cos  Oj,  0] 


The  system  (11.33)-(11.34)  is  in  the  form  of  (11.1)-(11.2). 
Let 


9*j  — 


cos  Oj  0 
sin  Oj  0 


0  1 

then  Equation  (11.33)  and  (11.34)  are  converted  into 


With  the  transformation 


< 


Xj 

=  u\j  cos  Oj  +  Pj  sin  Oj 

Vj 

=  u  1  j  sin  Oj  —  Pj  cos  Oj 

Oj 

=  u2j 

mjUlj 

=  -5-(nj  +  T2j) 

itj 

Li 

Ijii2j 

=  7^(n  j-T2j) 

Kj 

xij  —  Oj 

X‘2j  =  Xj  cos  Oj  +  yj  sin  Oj 
X3 j  =  —  Xj  sin  Oj  +  yj  cos  Oj 

V\j  =  —  U2j 

V2  j  ^1  j  %3j^lj 


Equation  (11.35)  can  be  converted  into  the  following  standard  form 


(11.35) 


where 

Mj 


and 


f  Xij  =  Vi  j 

J  *2 j  =  v2j 

I  X3j  =  X2jVij  -  Pj  _ 

{  MjV*j  +  CjV*j  =  BjT*j 


(11.36) 


13  +  mjXlj  <«P'3j 

rrijX3j  rrij 


mjX3jX3j  0  . 

rrijX3j  0  ’  j 


1 

Rj 


X’3j  T  Lj  X3j  Lj 

1  1 


+  Cj(q*j,  q*j)£  Yj(q*j,  q*j,  £)cq 
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where  the  inertia  parameter  vector  aj  =  [rrij,Ij]T, 


Yj  (q*j ,  q*j ,  £,  £) 


x3jil  +  x3j£  2  +  x3jx3j£l  £1 


x3j£  1  +  £2  + 


0 


The  consensus  problem  of  the  kinematics  in  (11.36)  can  be  solved  with  the  aid  of  the 
results  proposed  in  Theorem  11.1.  By  the  results  in  [7],  we  choose 


f*j  = 


€j  sin  f3j 
€j  COS  /3j 

Tsin2  fa 


€j  >  0 


Then 


df , 


*3 


dftij 


6j  COS  f3j 

—6j  sin  (3j 
\  cos  2f3j 


Pij 


It  can  be  verihed  that  fj  satishes  the  properties  in  Lemma  11.1. 
Let 


Z*j 


^3 j 


xlj  flj 
x2j  -  f'ij 

hj  -  flj  (x2 j 


hi 


the  controller  is  proposed  as 


vi  j 
v2j 


Vij 

V2j 


'  Vij 

1 

0 

6j  COS  / 3j 

-1 

1 

0 

0  ' 

V2  j 

= 

0 

1 

—ej  sin  f3 j 

2 

0 

1 

0 

1 - 

1 

5*' 

1 _ 

6j  COS  f3 j 

0 

Y  cos  2  (3j 

_  z2j 

-ej-sin  f3j 

1 

X/  aji{z*j 

ieAfj 


A 


*3 


X 


(11.37) 


(11.38) 


(11.39) 

(11.40) 


(11.41) 


where  >  0  and  A  j  is  defined  in  (11.12)  with  n  =  3. 

In  the  simulation,  we  choose  Pj(xj,  yf)  =  0.2  sin  t.  The  communication  graph  is  shown  as 
in  Fig.  11.1.  The  communication  graph  is  shown  as  in  Fig.  12.1.  Figs.  11.2-11.4  show  the 
time  response  of  xu,  x2*,  and  £3*,  respectively.  It  is  shown  that  the  state  of  three  systems 
reach  consensus. 

The  consensus  problem  of  the  dynamics  in  (11.36)  can  be  solved  with  the  aid  of  the  results 
in  Theorem  11.2.  The  controller  is  proposed  as  in  (11.29)-(11.30)  if  the  inertia  parameter 
vector  aj  is  a  constant  and  is  unknown.  Figs.  11.5-11.7  show  the  time  response  of  x  1  * ,  x2*, 
and  X3*,  respectively.  It  is  shown  that  the  state  of  three  systems  reach  consensus. 

If  the  inertia  parameter  vector  a3  is  a  constant  and  is  unknown,  we  can  also  solve  the 
consensus  problem  by  the  robust  control  algorithms  in  Theorem  11.3.  Figs.  11.8-11.10  show 
the  time  response  of  xi*,  x2*,  and  X3*,  respectively.  It  is  shown  that  the  state  of  three  systems 
reach  consensus. 
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Figure  11.1:  Communication  graph. 


Figure  11.2:  Response  of  xi*. 
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Figure  11.3:  Response  of  x 2*. 


Figure  11.4:  Response  of  X2*. 
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Figure  11.5:  Response  of  xi*. 


Figure  11.6:  Response  of  x 2*. 


150 


Figure  11.7:  Response  of  x 2*. 


Figure  11.8:  Response  of  xi*. 
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Figure  11.9:  Response  of  x 2*. 


Figure  11.10:  Response  of  X2*. 
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Chapter  12 


Distributed  Tracking  Control  of 
Multiple  Nonholonomic  Mechanical 
Systems  with  Non-ideal 
Nonholonomic  Constraints 


In  this  chapter,  we  consider  Problem  4  defined  in  the  last  chapter,  i.e.,  the  tracking  control 
problem  of  multiple  nonholonomic  mechanical  systems  in  (1.1)  and  (1.10). 


12.1  Distributed  Controller  Design  for  Kinematic  Sys¬ 
tems 


Consider  m  systems  where  the  j-th  system  is  defined  by 


—  Vij  +  4>lj{x\j) 

(12.1) 

X2j 

=  V2j  +  ( i>2j{x2j ) 

(12.2) 

Xij 

V \jXj—  \  j  -j-  (f)jj  (x^j ) ,  3  ^  2  ^  Tl 

(12.3) 

The  communication  between  systems  is  defined  by  a  directed  graph  Q  =  {V,  £}.  For  simple 
presentation,  it  is  assumed  that  the  communication  between  systems  is  bi-directional  in  this 
chapter. 

It  is  given  a  desired  trajectory  xd  =  [^i^, . . . ,  rrn(i]T  which  is  generated  by 


X\ d 

=  Vid 

(12.4) 

X2d 

=  v2  d 

(12.5) 

%id 

=  vldXi-i>d,  3  <i  <n 

(12.6) 

where  V\ d  and  v2d  are  known  functions.  It  is  assumed  that 


max  \xid\  <  1  <  i  <  n. 

tG[  0,oo) 
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where  Si  is  a  positive  constant. 

The  problem  considered  in  this  chapter  is  defined  as  follows. 

Tracking  Control  of  Multiple  Chained  Systems:  For  a  group  of  m  systems  in 
(12. 1)- (12.3) ,  it  is  given  a  desired  trajectory  xd,  the  problem  is  how  to  design  a  distributed 
control  law  (vij,  v2 j)  for  system  j  based  on  its  own  information  and  its  neighbors’  information 
such  that 

lim  (x*?  —  xd )  =  0,  1  <  j  <  m ,  (12.7) 

where  x*j  =  [x\ j, . . . ,  xnj\T . 

ft  is  assumed  that  the  uncertain  terms  in  (12. 1)-(12.3)  satisfy  the  following  conditions: 

|02j(%)|  <  72  j(%),  |  3  <i<n  (12.8) 

where  f3tJ  are  known  positive  functions. 

With  the  aid  of  the  results  in  [7],  we  have  the  following  results. 

Lemma  12.1.  For  the  system  in  (12.1)-(12.3),  there  exists  a  function  fj(/3*j,ej)  G  Rn  such 
that  the  the  matrix  Gj(/3*j)  =  [gij(fj),  g2j{fj ),  ■  ■  ■ ,  .]  is  nonsingular  for  any  /3*j 

and  6j  >  0,  where  gXj  =  [1,  0,  x2j, . . . ,  xn-ltj]T ,  g2j  =  [0, 1,  0, ... ,  0]T,  (5^  =  [fiij, /3n-2,j]T , 
f3  e  Rn~2  and  the  function  fj  has  the  following  properties: 

1.  fj  is  bounded  for  any  (3^; 

2.  lim£j._>0  fj(P*j,ej)  =  0. 

The  proof  of  Lemma  12.1  can  be  found  in  [7,  8].  The  construction  of  fj  can  be  found  also 
in  [7,8].  The  function  fj  is  called  the  transverse  function. 

With  the  aid  of  Lemma  12.1  and  the  notations  in  [7],  it  can  be  found  the  function  fj(/3j,  €j) 
such  that  Gj  is  nonsingular.  Let 


z*j  —  x*jfj(fi*j) 


-l 


then,  we  have  the  augmented  system 

z*j  =  drfj(ptj'j-i(x*j)dlZ:l:j(fj((3*j))Gj({3*j)[vij,v2j,—ftij,...,—/3n—2,j\  (12-9) 

We  define  the  neighbors’s  difference  as 

[^lj?  •  •  •  5  ^nj\  ^  )  &ji(z*j  ^*i)  T  bj(z*j  x  ).  (12.10) 

ieMj 

where  bj  =  1  if  the  desired  trajectory  is  available  to  system  j  and  bj  =  0  if  xd  is  not  available 
to  system  j.  If  /3*j  is  considered  as  an  additional  input,  we  propose  the  following  distributed 
control  law. 
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Theorem  12.1.  For  the  m  systems  in  (12.1)-(12.2),  if  the  communication  graph  has  a 
spanning  tree,  the  control  law 


vij  =  Vij  (12.11) 

V2  j  =  r)2  j  (12.12) 

Vij 
V2  j 

.  —fl*j 

ensures  that 


=  -G 


-1 


4_1  (x*j )  d'rfj  (/3tj )  {z*j ) 

*3 


E 

i&M, 


“Ji 


(z*j  -  z*i)  +  bj(z*j  -  Xd)  -  A.02.13) 


lim  1 1  a;*  7  —  xd\\  <  <5,-(e,-) 

t-»oo  J  J  J 


(12.14) 


where  5j  is  a  nonnegative  continuous  function  of  €j  and  Sj  converges  to  zero  when  ej  converges 
to  zero,  and 


(7l.7+^l)eij 

Vel7+e_t 


(T  nj  ~l ~^n)^nj 

-  - 


(12.15) 


Proof:  By  Lemma  12.1,  Gj  is  nonsingular.  So,  the  control  law  exists.  Substitute  the 
control  law  into  the  system  and  define  %  =  %  —  x^,  we  have 


zij  =  ~eij  -  -r=r==  +  E  “  xid 

efj  + 


%nj  ^ 


nj 


'Inj&nj 

4;  +  e-4 


T  fnj  i'nd 


Choose  a  function 


V  =  zT  £ez- 


where  5)*  =  [, zn , . . .  ,  ii;n]T  and  £  is  the  Laplacian  matrix,  we  have 


m  ry.  ,g2  m 

Vi  =  -zlc’cezi,~Y.  ,  ',v 

'  3".  -L  &  t 


j=i  V4  + e  i=l 


<  -zl£e£eZi*  -  Y  lij  V  4  + e_t  +  E 


m  g-t 


1=1 


i=i  V4  + e  7  i=i 


+  Et*iI< 


y  I 


<  -zjt£e£ez^  +  me  f/2 


(12.16) 

(12.17) 

(12.18) 


By  integrating  both  sides  of  the  above  inequality,  it  can  be  shown  that  z^  is  bounded  and 
£eZi *  converges  to  zero,  which  means  that  z*3  converges  to  zero.  Therefore,  (12.14)  holds. 
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Remark  12.1.  If  ej  (T  <  j  <  m)  are  chosen  to  be  small  constants,  )  is  a  small 

constant,  which  means  that  || —  xici\\  converges  to  a  small  neighborhood  of  the  origin.  We 
say  (12.7)  is  achieved  practically. 

Remark  12.2.  In  Theorem  12.1,  nothing  is  said  about  /3*j.  So,  (3*j  may  be  bounded  or 
unbounded.  Thanks  to  the  properties  of  the  function  fj,  the  boundedness  of  plays  no  role 
in  the  consensus  problem. 

12.2  Distributed  Controller  Design  for  Dynamical  Sys¬ 
tems 

We  considered  m  dynamical  systems.  The  j-th  system  is  defined  as 


%lj  —  V\ j  +  4>lj(xij) 

(12.19) 

%2j  =  V2j  +  02  j(x2j) 

(12.20) 

X'ij  X \jXj—  i  j  T  (Pij  (X'  ij  ) ,  3  Y  X  Y  Tl 

(12.21) 

MjV*j  T  CjV*j  +  Gj  +  Dj  =  BjTj 

(12.22) 

where  =  [vi j,V2j]T  and  x*3  =  (x\3, . . .  ,xnj\T.  The  following  properties  are  satisfied. 

Property  12.1.  Mj  is  bounded  and  Mj  —  2 Cj  is  skew- symmetric. 

Property  12.2.  For  any  differentiable  vector  £  G  K2 , 

Mjf  T  Cj'C  T  Y(X*j,  x^j, 

where  Yj  is  a  known  function  of  x*j,  x*j,  and  (,  and  aj  is  the  inertia  parameter  vector. 
The  problem  considered  in  this  section  is  defined  as  follows. 

Tracking  Control  of  Multiple  Systems:  For  a  group  of  m  systems  in  (12.19)-(12.22), 
the  problem  is  how  to  design  a  distributed  control  law  t3  for  system  j  based  on  its  own 
information  and  its  neighbors’  information  such  that 

hm  (x*,  —  c)  =  0,  1  <  j  <  m ,  (12.23) 

where  x^  =  [x\j, . . .  ,xnj\T  and  c  is  an  unprescribed  constant  vector  which  depends  on  the 
initial  condition  of  each  system  and  the  topology  of  digraph  Q. 

In  the  dynamics  (12.22),  we  first  assume  that  the  inertia  parameter  vector  aj  is  a  constant 
and  is  unknown. 

In  order  to  design  controllers,  we  let 


vij  =  v1:j  -  ?7i j  (12.24) 

v2 j  =  v-,j  -  i)>j.  1  <j<m  (12.25) 
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where  rjij  and  q2 j  are  defined  in  (12.11)  and  (12.12),  respectively.  Let 


then  we  have 


= 

e  \j 

\ 

hjeij 

=  +  <f>lj  +  Xl,l,jVlj  +  Xl,2  ,jV2j 

(12.26) 

elj  +  e- 

z2j  = 

e2j - 

A 

72  jC2j 

=  +  4>2  i  +  X2,ljhlj  +  X2,2,jV2j 

(12.27) 

Zij  = 

~eij 

V 

Aijeij 

=  +  4>ij  +  +Xi,ljhlj  +  Xi,2,jV2ji  3  <  i  <  n 

(12.28) 

leij  +  e' 

MjV*j 

T  CjV*j 

=  BjTj 

—  ( +  Cjq*j  +  Gj  +  Dj ) 

(12.29) 

where  v *j  =  [vij,v2j]T ■ 

For  the  dynamics  of  each  system,  we  have 

MjTjtj  +  +  Gj  =  x*j,  q '*?,  q*j)dj  (12.30) 

where  a3  is  the  inertia  parameter.  For  the  disturbance  Dj ,  it  is  assumed  that 

\\Dj\\  <  Pj(x*j)  (12.31) 


where  p3  is  a  known  function  of  x*3 .  If  the  inertia  parameter  a3  is  a  constant  and  is  unknown, 
we  have  the  following  results. 


Theorem  12.2.  For  the  m  systems  in  (12.19)-(12.22),  if  the  communication  graph  has  a 
spanning  tree,  the  control  law 


-i 


Ti  =  B3 


aj  Fj-Yj 


-KjV*j  +  Yjhj  -  pjsign(f)*j)  -  A3 


(12.32) 

(12.33) 


ensures  that  dj  is  bounded  and  (12.1 f)  holds,  where  Kj  and  Tj  are  positive  constant  matrices, 
and 


A?  ~ 


i,  lj 


i=  1 
n 


y^jGiXiXi 
L  i= 1 


(12.34) 


Proof:  Let 


n  m  ^  m  -y 

v  =  +  Y,  « («j  -  ai)Tr-1(ai  -  a3) 

i= 1  3= 1  1=1  Z 
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Differentiating  it  along  the  closed-loop  system,  we  have 

n  mm  m 

V  <  ~Y  zl£e£eZi*  -  Y  vJjKjV*j  -  Y  Pwjsign^)  -  Y  vjfij  +  me~t/2 

4=1  j= i  i=i  i=i 

n  m 

<  ~Y  zJ*£e£eZi*  -  Y  vJjKiV*i  +  me-t/2 

4=1  j  =  1 


By  integrating  both  sides  of  the  above  inequality,  it  can  be  shown  that  V  is  bounded,  which 
means  that  z^,  v*j  and  a3  are  bounded.  Furthermore,  it  can  be  shown  that  by  Barbalat’s 
lemma  that  e ;*  and  v*j  converge  to  zero.  Therefore,  (12.14)  holds.  ■ 

In  Theorem  12.2,  the  unknown  inertia  parameter  is  estimated  by  an  adaptive  control  law. 
If  an  estimate  of  a3  is  a3  and 

II aj  ~~  II  —  7 j 

for  1  <  j  <  m  and  7 j  is  a  known  constant,  we  propose  the  following  robust  control  laws. 

Theorem  12.3.  For  the  m  systems  in  (12.19)-(12.22),  if  the  communication  graph  has  a 
spanning  tree,  the  control  law 


Fj  v*j  -j-  1)  aj 


7j^jsign(y)T v*j)  -  /a,- sign ({;*,■)  -  A j 


(12.35) 


ensures  that  (12.1 4)  holds,  where  Kj  is  a  positive  constant  matrix  and  A 3  is  defined  in 
(12.34). 

Proof:  Let 

n  m  -1 

v  =  Y  +  Y 

4=1  3=1  Z 

Differentiating  it  along  the  closed-loop  system,  we  have 


n  mm  m 

Vj  <  ~Y  zl£e£eZi*  -  Y  vJjKjV*j  -  Y  PjvJjSign(v*j)  -  Y  Y^j 

4=1  j  =  1  3  =  1  j= 1 

m  m 

+  Y  vJjYMj  -  a3)  -  Y 1  3 v*j Yj sign ( v*j )  +  me~t/2 

3= 1  i=i 

n  m 

<  ~Y  zJ*£e£eZi *  -  Y  vJjKjV*j  +  rne~t/2 

4=1  j= 1 


Therefore,  V  is  bounded,  which  means  that  i)*  and  v*j  are  bounded.  By  Barbalat’s  lemma, 
it  can  be  shown  that  e ;*  and  v*j  converge  to  zero.  ■ 

In  Theorem  12.3,  the  unknown  inertia  parameter  aj  is  not  required  to  be  a  constant.  In 
the  control  laws,  7^  is  required  to  be  known.  It  is  possible  to  estimate  it. 


12.3  Simulation 

We  considered  three  nonholonomic  wheeled  mobile  robots  considered  in  Section  3.5. 
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The  constraint  on  the  front  wheels  can  be  written  as 


Xj  sin  9j  —  ijj  cos  9j  =  Pj(xj,  y.j ) 


(12.36) 


where  ( Xj ,  yj)  is  the  position  of  robot  j,  9j  is  the  orientation  of  robot  j,  and  Pj  denotes  slight 
slipping  along  the  axis  of  the  wheels.  The  dynamics  of  robot  j  are  described  by  the  following 
differential  equations 


rrijXj  =  Xj  cos  9j  +  —  (tij  +  r2j)  cos  9 

it 


=  - Xj  sin  °j  +  TT (n j  +  r2 j )  Sin  9 

it  A 


(12.37) 


tyj  =  7T':rU  -  r2i) 

Kj 


where  rrij  is  the  mass  of  robot  j,  and  Ij  is  its  inertia  moment  around  the  vertical  axis  at 
point  Q.  Rj  is  the  radius  of  the  wheels  and  2 Lj  the  length  of  the  axis  of  the  front  wheels, 
and  Tij  and  r2j  are  the  torques  provided  by  the  motors. 

Let  q*j  =  [xj,yj,9j]T, 


rrij 


iti 


0 

0  ' 

rrij 

0 

,Cj 

0 

Ij. 

cos  9j 

cos  9j 

sin  9j 

sin  9j 

Lj 

Lj  \ 

,  Cj(q*j,  qtJ )  0,  Gj(q*j)  0 


,  Jj  =  [sin  9j,  —  cos  9j ,  0] 


The  system  (12.36)-(12.37)  is  in  the  form  of  (12.1)-(12.2). 
Let 

cos  9j  0 
g*j  =  sin  93  0 
0  1 

then  Equation  (12.36)  and  (12.37)  are  converted  into 


Xj 

=  Uij  cos  9j  +  Pj  sin  9j 

Vj 

=  sin  9j  —  Pj  cos  9j 

0j 

=  u2j 

irijUij 

2 

=  iy(rij  +  T2j) 

llj 

T  J 

IjU2j 

=  I f(rij-ry) 

Kj 

It  is  given  a  desired  trajectory  qd  =  [qid,  q2d,  q3d]T  which  is  generated  by 

qid  =  vd  cos  q3d,  q2d  =  vd  sin  q3d,  q3d  =  ud 
where  vd  and  c od  are  time-varying  functions. 


(12.38) 
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With  the  transformation 


ocij  —  Qj 

X2j  =  Xj  cos  Oj  +  i/j  sin  Qj 
<  xsj  =  —  Xj  sin  Qj  +  yj  cos  Qj 

VX j  =  ~U2 j 

,  v2j  =  ulj  ~  x3jvlj 

Equation  (12.38)  can  be  converted  into  the  following  standard  form 


f  X!  j  =  Vi  j 

J  *2 j  =  v2j 

I  x3j  =  X2jVlj  -  Pj  _ 

[  MjV*j  +  CjV*j  =  BjT*j 


(12.39) 


where 


Mj  = 


ij+rrijxlj  mjX3j 


mjX3j 


rrij 


,Cj  = 


rrijX3jX3j  0 
rrijXsj  0 


Kj 


x3j  Lj  x3j  Lj 

1  1 


and 


Mj(q*j)£  +  Cj(q*j,  q*j)$,  Yj(q*ji  Q*ji  £>0% 
where  the  inertia  parameter  vector  a,j  =  [■ m,j,Ij]T , 


^  j  (y*j  >  Q*j  i  0 
By  the  transformation 


xl jii  +  x$ji  2  +  fi 


x3j£l  +  £2  +  x3j^l 


0 


xld  —  —q3d 

x2d  =  qu  cos  q3d  +  q2d  sin  q3d 
x3d  =  -qid  sin  q3d  +  q2d  cos  q3d 
Vid  =  ~UJd 
x2d  =  v\d  ~  x3dvld 

we  have 

xld  =  Vi  d,  X2d  =  V2  d,  X3d  =  V\dX2d- 

The  tracking  control  problem  of  the  kinematics  in  (12.39)  can  be  solved  with  the  aid  of 
the  results  proposed  in  Theorem  12.1.  By  the  results  in  [7],  we  choose 


= 


6j  sin  [3j 
6j  cos  / 3j 

i  sin  2/3, 


ei  >  0 


(12.40) 


Then 


dft 


*3 


d[5ij 


6j  COS  (3j 
—tj  sin  Pj 

Y  cos  2 f3 j 


Pi  j 


(12.41) 
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Figure  12.1:  Communication  graph. 


It  can  be  verified  that  fj  satisfies  the  properties  in  Lemma  12.1. 
Let 


■'*3 


x*jf> 


-i 

*j  j  *j 


xX i  At 

x2j  ~  f 2j 

X3 3  ~  f 3 3  "  flj(X2j  ~  hj)  . 


the  controller  is  proposed  as 


v\  j  =  Vij 
v-2  j  =  mj 


'  Vij 

1 

0 

6j  COS  f3j 

-i 

1 

0 

0  ' 

V2  j 

= 

0 

1 

—ej  sin  (3j 

2 

0 

1 

0 

1 - 

1 

1 _ 

€j  COS  I3j 

0 

y  cos  2  (3j 

. 

— €j  sin  /3j 

1 

(12.42) 

(12.43) 


E 


i  \  %*j 


Z*i)  4“  ^ *j 


(12.44) 


where  >  0  and  A  j  is  defined  in  (12.15)  with  n  =  3. 

In  the  simulation,  we  choose  Pj(xj,yj )  =  0.2 sin t.  The  desired  trajectory  xd  is  assumed 
to  be  xd  =  [xid,X2d,  x3d\T  =■  Figs.  12.2-12.4  show  the  time  response  of  xi*,  x2*,  and  x3*, 
respectively.  It  is  shown  that  the  state  of  three  systems  reach  consensus. 

The  tracking  control  problem  of  the  dynamics  in  (12.39)  can  be  solved  with  the  aid  of 
the  results  in  Theorem  12.2.  The  controller  is  proposed  as  in  (12.32)-(12.33)  if  the  inertia 
parameter  vector  a,j  is  a  constant  and  is  unknown.  Figs.  12.5-12.7  show  the  time  response  of 
Xi*,  x2*,  and  x3*,  respectively.  It  is  shown  that  the  state  of  three  systems  reach  consensus. 

If  the  inertia  parameter  vector  a3  is  a  constant  and  is  unknown,  we  can  also  solve  the 
consensus  problem  by  the  robust  control  algorithms  in  Theorem  12.3.  Figs.  12.8-12.10  show 
the  time  response  of  Xi*,  x2*,  and  x3*,  respectively.  It  is  shown  that  the  state  of  three  systems 
reach  consensus. 
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Figure  12.2:  Response  of  xi*. 


Figure  12.3:  Response  of  x 2*. 
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Figure  12.4:  Response  of  x 2*. 


Figure  12.5:  Response  of  xi*. 
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Figure  12.6:  Response  of  x 2*. 


Figure  12.7:  Response  of  X2*. 
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Figure  12.8:  Response  of  xi*. 


Figure  12.9:  Response  of  x 2*. 
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Figure  12.10:  Response  of  £2 *■ 
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Chapter  13 
Conclusions 


In  this  report,  we  summarized  our  achievements  in  research  and  education.  The  PI,  the 
graduate  students,  and  our  institute  have  been  benefitted  from  the  support  of  this  project. 
We  thank  the  financial  support  of  the  ARO  very  much  and  hope  in  the  future  we  can  receive 
financial  report  again. 
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